A D - A 0 i 6 263 

AN  ANALYSIS  OF  THE  RELATIONSHIP  OF  OVERAGE  TIME  SPANS 
IN  THE  CONTRACT-CLOSURE  PROCESS  AND  OPPORTUNITY  COSTS 

Frederick  N.  Galante,  et  al 

Air  Force  Institute  of  Technology 
Wright-Patterson  Air  Force  Base,  Ohio 

August  1975 


DISTRIBUTED  BY: 


IHi 


National  Technical  Information  Service 
U.  S.  DEPARTMENT  OF  COMMERCE 


ADA016263 


304164 


t 


AN  ANALYSIS  OF  THF,  RELATIONSHIP  OF 
OVERAGE  TIME  SPANS  IN  THE  CONiRACT- 
CLOSURE  PROCESS  AND  OPPORTUNITY  COSTS 

Frederick  N.  Galante,  Captain,  USAF 
Ronald  J.  Peterson,  Captain,  USAF 
Rick  J.  Williams,  1st  Lt , USAF 

SLSR  3 - 7 SB 


NATIONAL  TECHNICAL 
INFORMATION  SERVICE 

US  O*p«rtfnoft!  of  Commie®  X C X 

Sprmflf.dd,  VA.  22151  •A, 

UNITED  STATES  AIR  FORCE 
AIR  UNIVERSITY 

AIR  FORCE  INSTITUTE  OF  TECHNOLOGY 

Wright-Pattcrson  Air  Fore*  Bas«,Ohio 


USAF  SON  7S-203 


SISJL-3-75B 


AFIT  Control  Number 

AFIT  RESEARCH  ASSESSMENT 

The  purpose  cf  this  questionnaire  is  to  determine  the  potential  for  current 
and  future  applications  of  AFIT  thesis  research.  Please  return  completed 
questionnaires  to:  AFIT/SLGR  (Thesis  Feedback)  Wright -Patterson  AFB, 

Ohio  4 5433. 

1.  Did  this  research  contribute  to  a current  A;r  Force  project? 

a.  Yes  b.  No 

2.  Do  you  believe  this  research  tonic  is  significant  enough  that  it  would 
have  been  researched  (or  contracted)  by  your  organisation  or  another  agency 
if  AFIT  had  not  researched  it? 

a.  Yes  b.  No 

3.  The  benefits  of  AFIT  research  can  often  be  exnressed  i- ' the  equivalent 
value  that  your  agency  received  by  virtue  of  AFIT  performing  the  research. 

Can  you  estimate  what  this  research  would  have  cost  if  it  had  been 
accomplished  under  contract  or  if  it  had  been  done  in-houss  in  terms  of  man- 
power and/or  dollars? 

a.  Man-years  $ (Contract). 

b.  Man-years  $ (In-house). 

4.  Often  it  is  not  possible  to  attach  equivalent  dollar  values  to  research, 
although  the  results  of  the  research  may,  in  fact,  be  important.  Whether  or 
not  you  were  able  to  establish  an  equivalent  value  for  this  research  (3  above) , 
what  is  your  estimate  of  its  significance? 

a.  Highly  'b.  Significant  c.  Slightly  d.  Of  No 

Significant  Significant  Significance 

5.  Comments: 


Name"  and  Grade 


Position 


Organization 


Location 


UNCLASSIF 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  fWH*n  D*r*  tnurad) 


REPORT  DOCUMENTATION  PAGE 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


I.  GOVT  ACCESSION  NO.I  I PECIPI ENT'S  CATALOG  NUNBER 


• TITLE  f*»<f  Submit)  S.  TYNE  OF  REPORT  A PERIOD  COVERED 

AN  ANALYSIS  OF  THE  RELATIONSHIP  OF  OVERAGE 

TIME  SPANS  IN  THE  CONTRACT-CLOSURE  PROCESS  t ne^oam  ng  oro  report  num.e~ 
AND  OPPORTUNITY  COSTS  . performing  oro.  report  number 


i.  contract  or  grant  NUMBERS) 


7.  author (•) 

Frederick  N.  Galante,  Captain*  USaF 
Ronald  J.  Peterson*  Captain,  USAF 
Rick  J.  Williams*  First  Lieutenant,  USAF 

» PERFORMING  ORGANIZATION  name  and  aooress 

Graduate  Education  Division 
School  of  Systems  and  l^aistlcs 
Air  Force, Institute  of  Technology 

II.  CONTROLLING  OFFICE  NAME  AND  AOORESS 

Department  of  Research  and  Communicative 
Studies  (SLGR) 

AFIT/SLGR,  WPAFB.  OH  45433 


10,  PROGRAM  ELENENT,  PROJECT,  TASK 
AREA  A WORK  UNIT  NUMBERS 


U.  REPORT  DATE  _ 

August  1975 


11.  NUMBER  OF  PAGES 

103 


MONITORING  AGENCY  NAME  a ADDRESVff  ditto, tnt  from  Confroffjn*  Ollleo)  IS.  SECURITY  CLASS,  (ol  thl»  upon) 

UNCLASSIFIED 

IS*.  DECLASSIFICATION  DOWNGRADING 

schedule 


is.  distribution  statement  (oi  thtt  R*po/r> 


Approved  for  public  release*  distribution  unlimited 


17,  DlSTRiBuTlON  STATEMENT  (of  thm  ebefrecf  entered  in  B lock  20,  if  ditUttnt  from  Report) 


1»  SUPPLENENTARV  notes 


Approved  for  public  release  I AW  AIR  190-17 

('  L l '1  { t,(/'/c  r , 

JiyRftY  C.  JtfX,  Captain,  USAF 
ihrecior  of  Information,  AF1T 


19.  KEY  WORDS  (Continue  on  reverse  eirfe  / 'nereteery  anj  identity  by  bloc*  number; 


contract -closure 
Contract  Status  Report 
overage  contract 


opportunity  cost 
unliquidated  obligation 


20  ABSTRACT  'CO'ifinue  on  revere*  old*  It  nec«#e«ry  end  identity  by  biock  number; 


Thesis  Chairmam  Martin  D.  Martin,  Lieutenant  Colonel,  IJSAF 


DO  | 1473  EDITION  DF  1 NOV  SS  IS  OBSOLETE 


UNCLASSIFIED 

SECURITY  CLASSIFICATION  OF  THIS  PAC.C  fATifr,  Untrrrd) 


i^**S-*swi»A 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  OF  This  RACefirji**  D.l.  trtl.r.dj 


Department  of  Defense  acceptance  of  goods  or  services  purchased  by 
contract  does  not  signify  the  completion  of  a contract*  The  com- 
pletion of  the  required  administrative  tasks  subsequent  to  accept- 
ance is  called  the  contract-closure  process.  Delays  in  completing 
the  contract-closure  process  are  creating  opportunity  costs.  The 
opportunity  cost  of  an  extended  contract “closure  process  is  the 
alternative  that  is  sacrificed  to  maintain  the  present  contract- 
closure  process*  The  earlier  the  closure  process  is  completed , the 
earlier  excess  funds  can  be  released  to  other  government  projects. 
The  study  analyzed  the  overage  contracts  on  the  Contract  Status 
Report  issued  by  Air  Force  Contract  Management  Division.  Factors 
that  increase  the  overage  time  span  were  identified.  In  addition, 
the  opportunity  cost  (over  $2.8  million)  associated  with  these  fac- 
tors calculated.  The  conclusions  of  this  study  Indicate! 

(1)  overage  time  span  increases  with  face  value,  (2)  overage  time 
span  decreases  with  an  increase  in  unliquidated  obligation,  (3)  a 
few  overage  reason  codes  have  a significant  impact  on  the  overage 
time  span  of  contracts,  and  (4)  a majority  of  the  opportunity  cost 
incurred  is  attributable  to  a small  number  of  overage  reason  codes. 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  OF  This  PAGEflWi.fi  n.r.  Knit, ad) 


SLSR  3-7 5B 


AN  ANALYSIS  C?  THE  RELATIONSHIP  OF  OVERAGE 
TIME  SPANS  IN  THE  CONTRACT- CLOSURE 
PROCESS  AND  0?Vv)KIUMl  Y COSTS 


A Thesis 

Presented  to  the  Faculty  of  the  School  of  Systems  and  Logistics 
of  the  Air  Force  Institute  of  Technology 
Air  University 

In  Partial  Fulfillment  of  the  Requirements  for  the 
Degree  of  Master  of  Science  in  Logistics  Manag,ement 


By 


Frederick  N.  Gal-ante,  BM 
Captain,  USAF 
(Logistics  Management, 
Procurement  Major) 


Ronald  J . Peterson , BS 
Captain,  USAF 
(Logistics  Management, 
Facilities  Major) 


Rick  J.  Williams,  BS 
First  Lieutenant,  USAF 
(Logistics  Management, 
Procurement  Major) 

August  1975 

Approved  for  public  release* 
distribution  unlimited 


This  thesis*  written  by 

Captain  Frederick  N.  Galante 
(Logistics  Management,  Procurement  Major) 

Captain  Ronald  J.  Peterson 
(Logistics  Management,  Facilities  Major) 

and 

First  Lieutenant  Rick  J.  Williams 
(Logistics  Management,  Procurement  Major) 

has  been  accepted  by  the  undersigned  on  behalf  of  the 
faculty  of  the  School  of  Systems  and  Logistics  in  partial 
fulfillment  of  the  requirements  for  the  degree  of 

MASTER  OF  SCIENCE  IN  LOGISTICS  MANAGEMENT 

DATE i 13  August  1975 


COMMITTEE  CHAIRMAN 


ii 


ACKNOWLEDGMENTS 


We  wish  to  express  our  sincere  appreciation  to  our 
Faculty  Advisor , Lt.  Colonel  Martin  Dean  Martin,  for  his 
guidance  and  direction  in  the  preparation  of  this  thesis. 

His  constructive  comments  and  encouragement  aided  us  in 
this  thesis  effort. 

We  also  wish  to  express  our  thanks  to  Captain 
Stephen  Henderson,  Instructor  of  Logistics  Management,  who 
provided  guidance  in  the  development  and  analysis  of  the 
regression  equations. 

Grateful  appreciation  is  extended  to  Mr.  William  A. 
Schlobohm,  Headquarters,  Air  Force  Contract  Management 
Division,  who  provided  the  data  and  information  to  make  the 
study  possible.  Mr.  Donald  J.  O'Neill,  Acquisition  Manage- 
ment Information  System  Program  Office,  provided  Information 
and  invaluable  insight  into  the  problem.  The  professional- 
ism, cooperation,  and  enthusiasm  exhibited  by  these  people 
enhanced  our  understanding  of  the  contract -closure  process. 

A special  debt  of  gratitude  is  given  to  Gail  Galante 
for  her  patience,  tolerance,  and  understanding  during  the 
many  hours  required  to  complete  this  thesis.  Also,  a special 
thank  you  to  Ms.  Eleanor  Schwab  for  her  interest  and  profes- 
sional competence  in  the  preparation  and  typing  of  this 
thesis . 


Hi 


TABLE  OF  CONTENTS 


Page 

ACKNOWLEDGMENTS tit 

LIST  OF  TABLES vtt 

LIST  OF  FIGURES viil 

Chapter 

I.  INTRODUCTION  1 

Problem  Statement 1 

Overview  1 

Definitions 3 

Background 8 

Regulations 8 

Policy  statement  10 

Interviews 12 

Justification 12 

Scope.  . 14 

Research  Hypotheses 15 

Research  Questions 16 

II.  RESEARCH  LETHODOLOGY  17 

Uni vers?  Description  17 

Population  of  Interest  .....  18 

Sampling  Plan.  20 

Justification  for  Sampling  Plan 21 

Data  Collection 22 

Description  of  data  collection 22 

iv 


V 


Chapter  Page 

Design  of  Study . 24 

Sumary  of  Multiple  regression  analysis*  . 24 

Operational  definition  and  categorization 

of  the  variables  , . . . 24 

The  research  models 28 

Validation  of  regression  model  ......  29 

Coding  of  research  hypotheses  and 

research  questions  31 

Hypothesis  testing . 31 

III.  DATA  ANALYSIS 38 

Overview  .....  38 

Disposition  of  Data  Base 38 

General  Regression  Models.  41 

Sample  Application  of  the  Regression  Model  . 45 

Coefficient  Validation  Matrix.  46 

Category  A Contracts  47 

Effect  of  Category  Type  on  Overage 

Time  Span 50 

Analysis  of  Opportunity  Cost 50 

Summary  of  Assumptions  53 

Summary  of  Limitations  . . ► . 54 

IV.  STATISTICAL  AND  PRACTICAL  SIGNIFICANCE  OF 

RESEARCH  HYPOTHESES 56 

Introduction , . 56 

Research  Hypotheses  Related  to  Face  Value.  • 57 

Research  Hypotheses  Related  to 

Unliquidated  Obligation 58 

Statistical  and  Practical  Significance  of 

Reason  Code  Research  Hypotheses.  .....  59 


Vi 


Chapter  Page 

Support  of  Category  B Reason  Code 

Research  Hypotheses 60 

Support  of  Category  C Reason  Code 

Research  Hypotheses 63 

l • 

Statistical  Test  of  Research  Hypotheses 

Not  Supported ........  68 

1 

Non-Support  of  Category  B Reason  Code 

Research  Hypotheses . • . . 69 

Non-Support  of  Category  C Reason  Cede 

Research  Hypotheses.  . 69 

Sunnary  of  Research  Hypotheses  70 

Practical  Significance  of  Research 
Questions  1 - Bi  C 72 

V.  CONCLUSIONS  AND  RECOMMENDATIONS  FOR 

FUTURE  STUDY 73 

Overview  .....  73 

Conclusions 73 

Corollary  Conclusions 79 

Recommended  Future  Studies  .........  81 

Summary.  * 82 

APPENDICES 

A.  FORMS  RELATED  TO  00NTRACT- CLOSURE 83 

B.  LIST  OF  PERSONNEL  INTERVIEWED 88 

C.  SUMMARY  OF  OPPORTUNITY  COST 91 

D.  SUMMARY  OF  CATEGORY  C CONTRACTS  WITH  NO 

OVERAGE  TIME  SPAN.  95 

E.  SUMMARY  OF  CONTRACTS  DELETED  FROM  THE 

DATA  BASE.  . 97 

SELECTED  BIBLIOGRAPHY 99 

A.  REFERENCES  CITED  100 

B.  RELATED  SOURCES.  102 


mimmmnmmm* 


■JUJ'.  *».»» 


IPIIIJIi  iHUiyH  1 »'lHiMlli.lli.L,B>Li|BII>SWIW| WlWiJH  »■■»!  'M»IW  ^ 


t »'  •»  4 n* *'■«?'*** 


LIST  OF  TABLES 


Table  Page 

1.  Close-Out  Time  5;tandards . . . 7 

2.  Summary  of  the  Opinions  of  Contract- Closure 

Personnel  Interviewed  13 

3.  Summary  Table  of  Variables 25 

4.  Reason  for  Delayed  Closing  of  Contract  File  ...  27 

5.  Summarization  of  Statistical  Tests.  .......  35 

6.  Summary  of  Hypothesis  Testing  36 

7.  Summary  of  Contracts  Included  in  Study 40 

8.  Data  Base  Total  Dollar  Values 40 

9.  Regression  Coefficient  Values  43 


10.  Coefficient  Validation  Matrix- -Category  B . . . . 48 

11.  Coefficient  Validation  Matrix--Category  C . . . . 49 

12.  Opportunity  Cost- -Category  B.  .........  . 5l 

13.  Summary  of  Category  C Opportunity  Cost 5l 

14.  Total  Opportunity  Cost  Incurred  52 

15.  Non-Support  of  Category  B Reason  Code 

Research  Hypotheses  . . . ft 9 

16.  Non-Support  of  Category  C Reason  Code 

Research  Hypotheses  70 

17.  Summary  of  Research  Hypotheses  Test  Results  « . . 7l 

Practical  Significance  of  Research  Question 

1 ■ Bi  C 


18. 


72 


939^S5S5S523?^^2 


LIST  OF  FIGURES 

Figure  Page 

1.  Diagram  of  Contract-Closure  Process . 5 

2.  Total  Procurement  Dollars  by  Overage 

Category  Type 15 

3.  DOD  Organization  for  Contract  Administration  . . 18 

4.  AFPRO  Organization  and  Location 19 

5.  Quarterly  Cycle  of  Contract  Status  Report 

Data  Collection.  ..........  23 


viii 


.1  ,i.[  u hu  . ,i  j ^kh>  1 mi  r.rm  nrg» 


CHAPTER  I 
INTRODUCTION 


Problem  Statement 

Department  of  Defense  acceptance  of  goods  or  ser- 
vices purchased  by  contract  does  not  signify  the  completion 
of  a contract.  To  satisfy  administrative  requirements  many 
tasks  must  be  accomplished  after  acceptance  of  the  goods  or 
services  (I61I6).  The  completion  of  these  tasks  is  called 
the  contract-closure  process.  Each  task  is  to  be  completed 
within  specified  time  limits  (16).  If  completion  of  any  task 
exceeds  the  time  limits,  the  entire  contract-closure  process 
may  be  delayed.  This  delay  is  creating  an  opportunity  cost 
(4i4),  Specifically,  the  opportunity  cost  of  an  extended 
contract-closure  process  is  the  alternative  that  is  sacri- 
ficed to  maintain  the  closure  process.  The  alternative,  in 
this  case,  is  the  use  of  funds  obligated  to  the  contract. 

The  more  rapid  the  closure  process  is  completed  the  earlier 
excess  funds  can  be  released  to  other  government  projects 
( 1 4 ; 1 ) . This  study  will  identify  those  areas  which  are  major 
factors  in  causing  contract- closure  delays. 

Overview 

Procurement  of  goods  and  services  for  the  Department 
of  Defense  is  a complex  process.  The  viability  of  the  Armed 
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Forces  of  the  United  States  is  directly  linked  to  the  effi- 
cient operation  of  the  procurement  process  (5«37),  The  major 
vehicle  fcr  accomplishing  this  procurement  is  the  contract 
(l5tSec«l),  According  to  the  Air  Force  School  of  Systems  and 
Logistics  Continuing  Education  Contract  Administration  text 
ClOiIII-9),  there  are  three  general  phases  involved  in  the 
procurement  process.  The  three  phases  arei  (1)  the  Pre- 
award  Phase,  which  consists  of  defining  requirements,  solic- 
iting bids,  and  choosing  the  contractor j (2)  the  Award  Phase, 
in  which  the  actual  award  and  signing  of  the  contract  occurs; 
and  (3)  the  Post -award  Phase,  which  involves  the  performance 
of  the  contract,  acceptance  of  the  goods  or  services,  and 
finally  the  use  and  disposal  of  the  goods  by  the  government. 

The  dollar  value  of  a contract  can  vary  from  a few 
hundred  dollars  for  the  purchase  of  spare  parts,  to  well  over 
a billion  dollars  for  the  acquisition  of  a major  weapons  sys- 
tem. Irrespective  of  dollar  value,  the  efficient  administra- 
tion of  government  contracts  and  their  funds  is  necessary 
(3 1 31-42). 

In  many  respects,  the  success  of  any  procurement 
action  hinges  in  large  measure  on  how  the  contract  is 
administered  during  its  performance.  In  terms  of  multi- 
plicity of  functions  involved  and  the  time  span  of  per- 
formance, contract  administration  has  come  to  represent 
a major  field  in  procurement  and  a vital  element  in  the 
delivery  of  defense  materials  [5il0]. 

One  segment  of  contract  administration  that  has  been 
neglected  is  the  contract -closure  process.  As  stated  by 
Mr.  Donald  O'Neill,  Administrative  Contracting  Officer, 
Acquisition  Management  Information  System,  Systems  Program 
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Office,  at  Wright-Psttersor:  AFB,  Ohio*  "The  emphasis  in  the 
past  has  been  on  getting  funds  on  the  contracts  and  the  con- 
tracts out  the  doorj  there  was  little  attention  paid  to  the 
closure  process  [6]." 


Dt f : nitions 

To  provide  a common  frame  of  reference » the  terms 
used  in  this  study  are  defined  as  follows* 

A.  Date  Physically  Completed--The  date  the  govern- 
ment accepts  the  goods  or  services  that  have  been  contracted. 
This  acceptance  may  occur  at  the  buying  office,  plant,  or  any 
other  location  designated  by  the  contract.  This  date  sym- 
bolizes the  beginning  of  the  contract-closure  process  (8). 

B.  Contract-Closure  Process- >The  administrative 
requirements  that  must  be  accomplished  between  the  date  of 
physical  completion  and  the  date  the  contract  file  is  retired 
to  the  Federal  Records  Center.  Depending  on  the  category  of 
contract,  some  or  all  of  the  following  tasks  will  be  accom- 
plished (16)  i 

(1)  Disposition  of  classified  material 

(2)  Final  patent  report 

O)  Final  royalty  report 

(4)  Value  engineering  changes  complete 

(5)  Plant  clearance  complete 

(6)  Settlement  of  interim  or  disallowed  costs 

(7)  Settlement  of  subcontracts  by  the  prime: 
contractor 

(8)  Prior  year  overhead  rates  completed 
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(9)  Contractor's  closing  statement 

(10)  Contract  audit  complete 

(11)  Final  voucher  paid 

(12)  Final  removal  of  excess  funds 

(13)  Issuance  of  contract  completion  statement 

(14)  Retirement  of  contract  file  to  Federal 
Records  Center 

Figure  1 illustrates  the  contract-closure  process,  reference 
page  5. 

C.  Contractor  Final  Negotiated  Overhead  Rates--The 
expenses  that  cannot  be  assigned  directly  to  any  one  cost 
objective.  These  expenses  usually  are  not  calculated  until 
approximately  one  year  after  they  are  incurred.  For  cost- 
type  contracts,  these  expenses  are  negotiated  for  the  spe- 
cific year  they  are  incurred  and  incorporated  into  the  con- 
tract with  a supplemental  agreement  (l0iVII-3l). 

D.  Cost -Reimbursement  Contract --This  type  of  con- 
tract is  used  when  the  cost  of  the  work  cannot  be  adequately 
described  to  guarantee  performance.  The  contractor  is 
reimbursed  for  the  costs  he  experiences  in  tne  performance  of 
the  contract.  Certain  type*?  of  cost-reimbursement  contracts 
provide  for  an  incentive  fee  or  fixed-fee  that  is  paid  to  the 
contractor  (l0tIII-l). 

F.  Procuring  Contracting  Officer  (PCO)--Thc  official 
at.  the  buying  organization  who  negotiates  and  signs  the  con- 
tract for  the  needed  goods  and  services.  He  has  the  author- 
ity to  act  as  the  government's  representative  in  contractual 
matters  (1  5iSec.4 ,71-77) , 
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F,  Administrative  Contracting  Officer  (ACO)--The 
official  placed  in  charge  of  administering  a contract  by 
request  of  the  PCO.  It  is  the  AOO's  duty  to  monitor  the 
contract  and  assure  proper  compliance  with  all  contractual 
requirements.  The  authority  of  the  ACO  closely  parallels 
that  of  the  PCO  but  is  not  as  extensive  (l5»Sec. 4,71-77) , 

0,  Unliquidated  Obligation  (lil.O)- -Funds  that  have 
been  obligated  to  a goverriment  contract,  but  have  not  been 
paid  to  the  contractor  (lOiVIIl). 

H.  Ijate  of  Contract  Completion/Original  Milestone 
Closing  Date- -The  date  the  PCO  signs  the  DD  Form  1594  Con- 
tract Completion  Statement  (Appendix  A).  If  the  Acquisition 
Management  Information  System  (AMIS)  is  being  used,  it  is  the 
date  the  PCO  places  a letter  in  the  contract  file  signifying 
receipt  of  the  AMIS  PK9  (a  computer  format  identifier  for  the 
DD  Form  1594).  This  is  the  last  administrative  procedure 
before  the  contract  file  is  retired  to  the  Federal  Records 
Center  ( 16  *15). 

1.  Fixed-Price  Contract--This  type  of  contract 
usually  stipulates  a firm  price.  Under  the  fixed-price  type 
contract,  the  contractor  guarantees  the  performance  of  the 
contract.  Under  some  circumstances,  portions  of  the  price 
are  left:  open  and  adjusted  later  (lOiIII-l). 

J.  Contract  Status  Report  (CSR)--A  management  report 
used  by  *he  Air  Force  Contract  Management  Division,  Kirtland 
Air  Forc=>  Base,  New  Mexico,  to  record  contract  administration 
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progress.  Information  from  this  report  formulates  the  data 
base  for  this  study  (8). 

K,  Revised  Milestone  Closing  toe— The  date  the 
contract-closure  process  is  rescheduled  to  be  completed 
according  to  the  estimate  of  the  assigned  Administrative 
Contracting  Officer  (8). 

L.  Overage  Contract- -A  contract  that  has  not  been 
closed  within  the  standard  time  spans  delimited  in  the  Armed 
Services  Procurement  Supplement  2-305.  Overage  contracts  are 
divided  into  three  categories,  A,  B»  and  C.  Table  1 presents 
the  standard  time  spans  for  closing  contracts  and  defines 
Categories  A,  B,  and  C (16). 

Table  1 


Close-Out  Time  Standards 


Category 

Contract  Type 

Calendar  Months 
AFTER  the  Month 
in  which  Physically 
Completed 

A 

Fixed  Price  Small  Pur- 
chase Orders  ($2,500 
and  under) 

3 

B 

Firm  Fixed  Price 
(Excluding  A above) 

6 

C 

All  Other 

20 

Sourcet  Armed  Services  Procurement  Supplement  2-305, 

Washington,  D.C.t  U.S,  Government  Printing  Office, 
1 July  1974. 


M.  Contract  Face  Value- -The  total  value  of  the  con- 
tract. This  amount,  includes  the  original  contract  amount 
plus  any  amounts  that  have  been  added  to  the  original  con- 
tract by  supplemental  agreements. 

N.  Opportunity  Cost — The  alternative  that  must  be 
sacrificed  to  maintain  the  status  quo.  In  this  study  oppor- 
tunity cost  refers  to  the  time  value  of  the  unliquidated 
obligation  that  remains  on  a contract  due  to  delays  in  the 
contract -closure  process.  Opportunity  cost  is  a function  of 
unliquidated  obligation*  overage  time  span*  and  the  discount 
rate  defined  in  Department  of  Defense  Directive  7041.3  (17). 


background 


The  body  of  knoc-odge  available  on  the  subject  of 
contract-closure  is  limited.  The  information  available  can 
be  divided  into  three  general  categories  (1)  regulations, 
(2)  policy  statements*  and  (3)  interviews  with  personnel  in 
the  contract-closure  field. 


Regulations.  The  procurement  policy  of  the  Depart- 
ment of  Defense  (DOD)  is  defined  in  the  Armed  Services  Pro- 
curement Act  of  1947. 

The  Procurement  Act  provides  for  two  methods  of  pro- 
curement, formal  advertising  and  negotiation.  Formal 
advertising  must  be  used  except  when  advertising  falls 
within  certain  categories  of  the  Act.  These  categories 
or  exceptions  as  they  are  referred  to*  provide  the 
authority  to  negotiate.  The  Act  also  prescribes  certain 
procedures  for  formal  advertising  and  sets  forth  specific 
restrictions  and  qualifications  as  to  type  of  contracts 
that  may  be  used  (_10iI-2], 
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The  Procurement  Act  i9  limited  to  general  procurement  policy. 
Therefore,  under  the  direction  of  the  Assistant  Secretary  of 
Defense  (Installations  and  Logistics),  the  Armed  Service 
Procurement  Regulation  (ASPR)  is  issued  pursuant  to  DOD 
Directive  4105.30  dated  March  11,  1959.  This  regulation 
provides  fori 

...  carrying  out  the  provisions  of  the  Procurement 
Act  and  to  establish  policies  for  procurement  areas  not 
covered  by  it.  In  addition,  the  ASPR  provides  direction 
and  guidance  for  complying  with  pertinent  statutes  and 
executive  orders.  It  covers  policies,  practices,  and 
procedures  for  both  formal  advertising  and  negotiation. 

It  also  covers  other  procurement  topics  such  as  pricing, 
types  of  contracts,  contract  clauses,  and  contract  cost 
principles  [l0il-3j. 

The  specific  section  within  ASPR  that  deals  with  contract- 
closure  is  Supplement  2.  A review  of  ASPR  Supplement  2 
revealed  a lack  of  detailed  contract- closure  procedures.  The 
supplement  deals  with  results,  but  does  not  mention  the  pro- 
cedures to  be  followed  to  obtain  these  results.  The  majority 
of  the  close-out  procedure  is  left  to  the  discretion  of  the 
ACO.  Of  the  twenty-four  sections,  appendices,  and  supple- 
ments to  ASPR  (over  3,000  pages)  only  five  pages  are  written 
on  contract-closure  (16 i 15-19). 

ASPR  Supplement  2 formulates  the  basis  of  contract- 
closure  policy  from  which  administrative  procedures  were 
developed.  Apparently  the  volume  of  procurement  within  the 
last  ten  years  indicated  a need  for  an  automated  contract 
administrative  system.  These  needs  were  to  be  satisfied  by 
the  creation  of  the  Military  Standard  Contract  Administration 
Procedures  (MILSCAP)-DOD  4105. 63-M. 


[MILS CAP]  . . . prescribes  standard  procedures  for 
use  in  exchanging  procurement/contract  administration 
data  between  purchasing  offices  (including  inventory  and 
program  managers)  and  field  contract  administration 
offices,  e.g.,  DCASRs  [Defense  Contract  Administration 
Service  Regions]  and  plant  cognizance  representatives. 
This  information  system  is  designed  for  high  speed  digi- 
tal data  transmission  and  automatic  data  processing 
systems.  Procedures  shown  . . . were  developed  by  agree- 
ment between  representatives  from  all  Military  Depart- 
ments. Defense  Supply  Agency,  and  the  GASD  (Comptroller) 
[I8iij. 

After  completion  of  the  manual,  MILSCAP  waa  not 
implemented.  However,  a systems  program  office  (SPO)  located 
at  Wright -Patterson  Air  Force  Base  is  revising  MILSCAP  for 
use  by  the  Air  Force  Systems  Command  under  the  acronym  AMIS 
(Acquisition  Management  Information  System).  The  system  will 
specify  a step-by-step  contract-closure  process.  Phase  I of 
AMIS  is  currently  operational  and  incorporates  aspects  of  th< 
MILSCAP  contract- closure  procedures.  Phase  II  of  AMIS  will 
be  a real  time  contract  management  program  that  will  track 
all  events  specified  in  the  closure  process.  Phase  II  is  not 
expected  to  be  implemented  until  December  1976. 


Policy  statement.  No  Department  of  Defense  regula- 
tions concerning  contract -closure  procedures  have  been  issued 
since  Supplement  2 of  the  ASPR  was  revised  in  1970.  However, 
inter-staff  letters  and  staff  studies  reveal  tha“  a policy 
statement  may  be  Issued  in  the  near  future.  The  possibility 
is  illustrated  in  the  recommendations  from  inter-staff 
letters  that  have  been  issued  as  recently  as  September  1974 
(111  13). 
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A Memorandum  to  the  Chairman  of  the  ASFR  Committee, 
dated  4 December  1973,  entitled,  "The  Minority  Position 
Regarding  Use  of  an  Overhead  Milestone  Form,"  suggests  that 
untimely  contract -closure  is  creating  a 

drain  on  Contract  Administration  Services  resources 
Land]  . . . warrants  Committee  action  to  either  (1)  pro- 
vide! the  AGO  with  a tool  to  coordinate  and  expedite 
overhead  settlement  and  contract  close  out  as  proposed 
by  DCAS,  or  (2)  extend  the  twenty  month  standard  in 
ASPR  S2-305.  . • . DCAS  believes  that  the  latter  alter- 
native would  not  only  evade  the  real  issue  of  delayed 
overhead  settlement  . • . but  would  also  fall  to  alle- 
viate the  problem  • . . of  completed  but  unclosed  con- 
tracts no  matter  whr.t  the  standard  in  ASPS  2-305 
[l9»Tab  F-2J. 

A letter  from  the  Director  of  Procurement  Support 
at  Air  Force  Systems  Command  (AFSC),  dated  29  August  1974, 
to  the  Air  Force  Contract  Management  Division  at  Klrtland 
Air  Force  Base,  New  Mexico,  further  reinforces  the  idea  that 
there  is  a current  effort  being  made  to  issue  a policy  state- 
ment in  the  area  of  timely  contract-closure.  This  letter 
requests  data  to  . . satisfy  an  analysis  of  three  areas 
related  to  physically  completed  contracts  [l2»l].*  The  three 
areas  being  analyzed  by  AFSC  are»  (1)  the  time  periods  for 
closing  physically  completed  contracts,  (2)  the  reasons 
physically  completed  contracts  are  not  closed  within  the 
ASPR  standard  times,  and  (3)  the  amount  of  excess  funds  after 
final  payment  as  opposed  to  the  amount  of  excess  funds  on 
contract  upon  physical  completion  (12 »1). 

Another  letter  from  the  DCS/Coraptroller,  AFSC,  dated 
13  September  1974,  indicates  interest  in  the  contract-closure 
area  is  being  generated  by  finance  as  well  as  procurement 
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personnel*  This  letter  addresses,  once  again,  the  amount  of 
unliquidated  obligation  (ULO)  remaining  on  a contract  after 
the  date  of  physical  completion  and  recommends  procedures  to 
monitor  funds  more  closely  (lit 2). 

Interviews.  There  is  a lack  of  written  literature 
concerning  the  contract-closure  process » therefore,  a major- 
ity of  the  knowledge  gained  concerning  this  process  has  been 
obtained  through  interviews  with  personnel  who  are  working 
in  the  contract-closure  field  (Appendix  B).  These  officials 
have  related  the  past  history  of  this  process,  stated  the 
current  status  of  contract -closure  in  their  particular 
organisations,  discussed  their  personal  opinions  concerning 
problem  areas  within  contract -closure,  and  offered  sugges- 
tions for  correction  of  these  problems. 

Although  the  personnel  interviewed  represented  many 
diverse  organizational  backgrounds,  the  opinions  expressed 
concerning  the  contract -closure  process  were  similar.  The 
opinions  of  the  personnel  interviewed  (Appendix  B)  are  sum- 
marized in  Table  2,  page  13. 

Justification 

There  is  a need  for  a full  scale  review  of  contract- 
closure  procedures.  Top  level  management  at  the  Air  Force 
Systems  Command,  Defense  Supply  Agency,  and  Air  Force  Con- 
tract Management  Division  realize  that  the  present  contract- 
closure  procedures  are  inefficient  ( 1 2 ; 1 3 * 19).  In  an 
inter-staff  letter  by  Brigadier  General  Hans  Driessnack, 


ryvpmvm  w w * '**  i "J  ■« 1 iw  f^mm 


13 

DCS/Comptroller/AFSC,  emphasis  was  placed  on  the  efficient 
closure  of  contracts  to  prevent  the  problems  related  to  funds 
stagnation  (11 i 2).  After  interviewing  15  individuals 
(Appendix  B)  performing  i'  a wide  range  of  functions  related 
to  the  contract-closure  process,  it  was  noted  that  their 
opinions  were  based  on  suspected  causes . None  of  the  per- 
sonnel interviewed  could  reference  a detailed  study  that 
supported  their  suspicions.  The  consensus  of  the  individuals 
interviewed,  indicates  that  there  is  not  enough  emphasis 
placed  on  con tract -closure  and,  as  a result,  the  present 
contract- closure  procedures  are  inefficient. 

Table  2 

Summary  of  the  Opinions  of  Contract-Closure 
Personnel  Interviewed 


1.  High  level  management  is  concerned  with  the  contract- 
closure  process. 

2.  Procedures  concerning  this  process  should  be  more 
clearly  defined. 

3.  Clear,  concise  procedures  would  eliminate  the  admin- 
istrative costs  presently  being  incurred  because  of 
ambiguous,  limited  ASPR  procedures <■ 

4.  The  negotiation  of  contractor  final  overhead  rates  is 
preventing  the  timely  closure  of  contracts . 


No  literature  has  been  located  that  indicates  there 
has  been  a study  accomplished  which  supports  the  opinions 
repeatedly  expressed  during  the  personal  interviews.  The 
material  available  concerning  contract- closure  consists  of 
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policy  letters,  Supplement  2 of  ASPR,  summaries  of  ASPR 
presented  in  contract  administration  textbooks,  staff  let- 
ters concerned  with  topics  related  to  contract -closure,  and 
the  Military  Standard  Contract  Administration  Procedures 
(MILSCAP)  manual*  Apparently,  no  one  has  made  an  effort  to 
synthesize  the  existing  policies  and  procedures,  nor  has 
anyone  tried  to  scientifically  analyze  the  suspected  problem 
areas  of  contract-closure, 


Scone 

"Contract  closing  requirements  vary  with  the  dollar 
value,  complexity,  and  type  of  contract  [lOixx-l]."  This 
study  Includes  Category  A,  B,  and  C Contracts  being  admin- 
istered by  the  Air  Force  Contract  Management  Division 
(AFCMD).  Category  A,  B,  and  C Contracts  are  defined  In 
Supplement  2 of  ASPR  (reference  page  7,  Table  1).  Figure  2, 
page  15,  illustrates  the  distribution  of  total  procurement 
dollars  by  overage  category  type. 

To  limit  the  population  and  provide  for  a more  real- 
istic sample,  this  study  addresses  only  overage  contracts 
contained  in  the  physically  complete  section  of  the  Contract 
Status  Report  (CSR).  This  report  is  discussed  in  Chapter  II 
under  Data  Collection.  The  data  base  developed  from  the  CSR 
will  be  used  to  test  the  validity  of  the  research  hypotheses. 


owiwwijm  mvmmr 


mm- 


15 


Category  A 
Contracts 


Category  B 
Contracts 


Category  C 
Contracts 


Total  Procurement  Dollars  by  Overage  Category  Type 


Source i Contract  Status  Report.  Kirtland  AFB,  New  Mexico* 
28  February  1975. 


Research  Hypotheses 

There  are  three  basic  research  hypotheses  in  this 
study.  The  coding  of  these  research  hypotheses  is  discussed 
in  Chapter  IX,  Research  Methodology,  page  31,  The  research 
hypotheses  to  be  tested  arer 

Research  Hypotheses  1 - AX23J  BX23}  CX23 

There  is  a relationship  between  the  time  span  a 
contract  is  overage  and  the  face  value  of  the  contract. 

Research  Hypotheses  2 - AX24J  ^24 
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There  is  a relationship  between  the  tine  span  a 
contract  is  overage  and  the  unliquidated  obligation. 

Research  Hypotheses  3 - AX1<.22»  bxi-22‘  ^1-22 

There  is  a relationship  between  the  time  span  a 
contract  is  overage  and  the  reason  codes  for  overage. 


In  addition  to  the  research  hypotheses,  one  research 
question  will  be  tested  for  each  overage  category. 

Research  Questions  1 - Ai  Bi  C 

Is  a disproportionate  amount  of  opportunity  cost 
caused  by  a small  number  of  overage  reason  codes? 


CHAPTER  II 


RESEARCH  METHODOLOGY 
Universe  Description 

The  universe  for  this  study  consisted  of  all  overage 
contracts  being  administered  by  Department  of  Defense  (DOD) 
components!  the  Defense  Contract  Administration  Service 
(DCAS),  the  Army,  the  Navy,  and  the  Air  Force.  Overage  con- 
tracts are  defined  as  those  contracts  that  have  not  been 
closed  within  the  standard  time  spans  specified  in  the 
Armed  Services  Procurement  Supplement  2-305.  Overage  con- 
tracts are  divided  into  three  categories,  A,  B,  and  C. 

This  study  addressed  all  three  categories.  Table  1,  page  7, 
presents  the  standard  time  spans  for  closing  contracts  and 
defines  Categories  A,  B,  and  C.  The  DOD  organization  for 
contract  administration  is  presented  in  Figure  3,  page  18. 

Since  the  DOD  administers  contracts  world-wide,  in  a 
broad  spectrum  of  dollar  values , the  universe  includes  DOD 
contracts  of  all  dollar  values  and  geographical  locations. 
The  fact  that  all  DOD  components  administer  their  contracts 
according  to  the  Armed  Services  Procurement  Regulation  pro- 
vides homogeneity  in  respect  to  the  administration  of  the 
contracts  In  the  universe. 
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DOD 
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Defense  Contract  DOD  Plant 

Administration  Cognizance 


Figure  3 


DOD  Organization  for  Contract  Administration 


Sourcei  U.S.  Department  of  the  Air  Force.,  "AFCMD  Informa- 
tion Pamphlet."  Kirtland  AFB,  New  Mexico. 

August,  1972. 


The  population  consists  of  all  contracts  adminis- 
tered by  the  Air  Force  Contract  Management  Division  (AFCMD)* 
Kirtland  Air  Force  Base,  New  Mexico.  AFCMD 


. . • performs  contract  management  functions  at 
those  contractor  plants  assigned  to  the  Air  Force  for 
plant  cognizance  and  ensures  the  government's  interest 
while  executing  assigned  and  delegated  contract  admin- 
istration functions  [9]. 

An  analysis  of  Figure  4,  page  19,  illustrates  the  organiza- 
tional structure  and  location  of  the  Air  Force  plant  cog- 
nizance offices,  also  termed  Air  Force  Plant  Representative 
Offices  (AFPRO's),  which  report  to  the  Commander  of  AFCMD. 
The  contracts  administered  by  the  Air  Force  Plant  Represen- 
tative Offices,  located  in  the  United  States,  vary  from 
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small  dollar  amounts  to  major  weapon  systems  acquisitions  in 
the  millions  of  dollars*  The  contracts  in  the  population 
were  not  limited  by  dollar  value • administering  AFPRO*  or 
contract  type* 

Sampling  Plan 

Since  all  overage  contracts  are  categorized  as  A*  B» 
or  C Contracts*  these  categories  formed  predetermined  divi- 
sion points*  The  division  points  provided  three  distinct 
sections  for  analysis  within  the  Contract  Status  Report 
(CSR).  The  following  procedure  was  used  to  extract  the  raw 
data  and  code  it  in  the  proper  format  for  keypunching  the 
computer  cards i the  cards  then  formulated  the  data  base  for 
this  study i 

1*  All  overage  contracts  were  identified  and 
labeled  as  A*  B,  or  C category  contracts. 

2*  All  the  contracts  in  each  category  were  assigned 
an  Integer  number  so  that  the  contracts  could  be  uniquely 
identified* 

3.  After  each  contract  was  labeled*  the  following 
information  was  extracted i 

a.  Type  of  Contract 

b.  Original  Milestone  Closing  Date 

c.  Revised  Milestone  Closing  Date 

d.  Reason  for  Delay 

e.  Total  Contract  Amount 

f*  Unliquidated  Amount 
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4.  Upon  completion  of  the  data  extraction,  the 
worksheets  were  checked  against  the  CSR  to  insure  accuracy 
of  extraction. 

5.  The  data  on  the  worksheets  was  keypunched  and 
checked  for  errors  to  insure  accuracy. 

6.  The  BMD02R  Stepwise  Regression  Program  was  used 
to  calculate  a mean  and  standard  deviation  for  the  face 
value  of  the  A,  B»  and  C category  contracts.  (A  discussion 
of  the  BMD02R  Regression  Program  is  presented  on  page  29.) 

Justification  for  Sampling  Plan 

The  sample  analyzed  was  a sample  of  convenience  taken 
from  the  28  February  1975  Contract  Status  Report  (CSR)  issued 
by  AFCMD.  This  specific  Contract  Status  Re,>ort  was  chosen 
because  it  represented  the  most  accurate,  complete,  and  cur- 
rent collection  of  data  available  concerning  the  subject  pop- 
ulation. Since  the  sample  was  not  random,  a description  of 
the  sample  is  provided  to  allow  the  reader  to*  (1)  visualize 
the  population  which  the  sample  represents,  and  (2)  determine 
for  himself  if  the  group  to  which  they  had  hoped  to  general- 
ize these  results  differed  in  any  significant  manner  from  the 
sample  (2 1 327 ) • The  sample  had  the  following  characteristics! 

1.  The  sample  consisted  of  all  overage  contracts 
administered  by  the  Air  Fo  rce  Contract  Management  Division 
as  of  28  February  1975. 

2.  The  contracts  were  not  limited  by  administering 
AFPRO  or  contract  type. 
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3.  The  sample  consisted  of  888  contracts i 797 
Category  C contracts,  79  Category  B contracts,  and  12  Cate- 
gory A contracts.  (There  were  1359  overage  contracts  listed 
on  the  CSRi  Appendix  E summarizes  the  reasons  47l  contracts 
were  deleted  from  the  sample.) 

4.  To  be  retained  in  the  sample,  the  following 
information  items  had  to  be  included  on  the  contract. 

a.  Original  Milestone  Closing  Date 

b.  Revised  Milestone  Closing  Date 

c.  Overage  Reason  Code 

d.  Total  Contract  Amount 

This  sample  was  taken  from  the  population  of  con- 
tracts managed  by  the  Air  Force  Contract  Management  Division. 
Therefore,  inferences  will  be  limited  to  those  contracts  that 
are  defined  in  the  population  of  interest.  Even  though  all 
Department  of  Defense  components  administer  their  contracts 
according  to  the  Armed  Service  Procurement  Regulation, 
internal  procedures  for  contract-closure  within  the  Depart- 
ment of  Defense  components  differ.  This  study  does  not  make 
inferences  to  the  universe. 

Data  Collection 

Description  of  data  collection.  The  Administrative 
Contracting  Officer  (AGO)  assigned  to  a specific  contract  is 
required  to  submit  data  updating  the  Contract  Status  Report 
( CSR)  on  a quarterly  basis.  A review  of  Figure  5,  page  23, 
illustrates  the  CSR  quarterly  updating  cycle. 
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The  cycle  begins  when  the  AOO  updates  the  CSR  by 
annotating  on  hts  copy  of  the  CSR  any  changes  that  have 
occurred  In  the  status  of  the  contract.  The  AOO  has  35  days 
to  make  these  changes  and  return  the  updated  CSR  to  Air  Force 
Contract  Management  Division  (AFCMD)  Headquarters.  Upon 
receipt  of  the  CSR,  the  Acquisition  Management  Information 
System  section,  AFCMD/ ACQ,  extracts  the  changes  annotated 
by  the  ACO.  This  data  is  then  keypunched  and  forwarded  to 
the  Production  Control  Branch,  AFCMD/ ACDC,  where  the  data  is 
entered  into  the  computer  data  base.  The  updated  Contract 
Status  Report  is  then  published  and  distributed  to  the  Air 
Force  Plant  Representative  Offices  and  the  cycle  repeats 
itself  (8). 


Figure  5 

Quarterly  Cycle  of  Contract  Status  Report 
Data  Collection 


All  data  used  in  this  study  was  extracted  from  the 
28  February  1975  Contract  Status  Report  (CSR)  generated  at 
Air  Force  Contract  Management  Division  (AFCMD),  Kirtland 
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Air  Force  Base,  New  Mexico.  The  CSR  Is  the  primary  manage- 
ment tool  used  by  AFCMD  to  track  and  record  contract  close- 
out progress* 


i 


i 


s 


r 
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Design  of  Study 


Summary  of  multiple  regression  analysis.  The  gen- 
eral form  of  the  multiple  regression  model  Isi 


Y - BQ  + B-jX-^  + B2X2  + 


...  + BltXu 


where  Y is  the  estimated  value  of  the  dependent  variable  and 
X denotes  values  for  the  Independent  variables.  The  BQ  term 
Is  a constant.  The  value  of  BQ  Is  dependent  upon  the  nature 
of  the  variables  which  are  Included  In  the  model.  The  terms 
B| .B^B^, • • . ,B^  are  the  net  regression  coefficients i each 
coefficient  measures  the  change  per  unit  of  the  dependent 
variable  for  one  unit  change  In  the  Independent  variable 
(20t304).  An  operational  definition  of  Y,  the  dependent 
variable,  and  all  X values,  the  Independent  variables,  fol- 
lows. 


Operational  definition  and  categorization  of  the 
variables . A tabular  summarization  of  variables,  defini- 
tions, classification  level,  range  of  values,  data  level, 
and  units  of  input  are  presented  in  Table  3,  page  25.  The 
following  expanded  definitions  are  presented t 

1*  Dependent  Variables  - -Y^ , Y2#  and  Y-j  correspond 
to  the  time  span  between  the  Original  Milestone  Closing 
Date  and  the  Revised  Milestone  Closing  Date  for  A,  B,  and  C 


^^.«sWtf,:J»*-^'«^>*<^w'^i*»JUi.,n;4'  *■ 


contracts,  respectively.  The  Original  Milestone  Closing  Date 
Is  the  original  date  the  contract-closure  process  was  to  be 
completed  In  accordance  with  Armed  Services  Procurement  Sup- 
plement 2-305.  The  Revised  Milestone  Closing  Date  Is  the 
date  the  contract -closure  process  Is  rescheduled  for  comple- 
tion according  to  the  estimate  of  the  responsible  Adminis- 
trative Contracting  Officer.  The  time  span  was  used  to  cal- 
culate the  opportunity  costa  referred  to  In  Research  Ques- 
tion One. 

2.  Independent  Variables --The  Independent  variables 
range  from  to  X2^.  X2?  was  the  Total  Contract  Amount 

appearing  on  the  Contract  Status  Report,  measured  In  dollars. 
The  face  value  varied  from  a few  dollars  to  over  one  billion 
dollars.  X24  was  the  dollar  amount  appearing  on  the  CSR 
under  the  category  Unliquidated  Amount.  The  Unliquidated 
Amount  Is  the  amount  of  money  that  has  been  obligated  to  the 
contract,  but  has  not  been  expended.  The  unliquidated  amount 
Is  measured  in  dollars  and  ranged  from  zero  to  approximately 
two  million  dollars.  The  independent  variables  X^  through 
X22  ate  termed  dummy  variables  since  the  only  values  they  can 
assume  are  zero  and  one.  The  use  of  dummy  variables  is  fur- 
ther explained  by  the  fact  that  each  overage  contract  could 
be  coded  for  only  one  reason  for  going  overage.  The  reasons 
a contract  goes  overage  are  coded  on  the  CSR  in  an  alpha- 
character  form  under  the  category  heading  "Reason  for  Delav," 
These  reason  codes  and  their  associated  variable  name  (X^  to 
X22)  are  contained  In  Table  4,  page  27. 


Table  4 

Reason  for  Delayed  Closing  of  Contract  File 


Definition!  The  factors  which  contribute  to  the  delay  in 
closing  the  contract  file  within  the  time 
period  established  as  the  norm. 


Independent 

Variable 


Explanation 


Contractor  has  not  submitted  final 
invoice/ voucher . 

Final  acceptance  not  received. 

Contractor  has  not  submitted  patent/ 
royalty  report. 

Patent/royalty  clearance  required. 

Contractor  has  not  submitted  pro- 
posal for  final  price  redetermina- 
tion. 

Supplemental  agreement  covering  final 
price  redetermination  required. 

Settlement  of  subcontracts  pending. 

Final  audits  in  process. 

Disallowed  cost  pending. 

Final  audit  of  Government  property 
pending. 

Independent  Research  and  Develop- 
ment rates  pending. 

Negotiation  of  overhead  rates 
pending. 

Additional  funds  requested  but  not 
yet  received. 

Reconciliation  with  Paying  Office 
and  contractor  being  accomplished. 

Armed  Services  Board  of  Contract 
Appeals  case. 

Public  Law  85-804  case. 
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Table  4 (continued) 


Code 

Independent 

variable 

Explanation 

S 

(X17) 

Litigation/investigation  pending. 

T 

(X18> 

Termination  in  process. 

U 

(xl9) 

Warranty  clause  action  pending. 

V 

(X2q) 

Disposition  of  Government  property 
pending. 

W 

(X21) 

Contract  modification  pending. 

X 

<x22) 

Contract  release  and  assignment 
pending. 

Sourcei  U.S.  Department  of  Defense.  Military  Standard  Con- 
tract Administration  Procedures.  DOD  4105. 63-M, 
Office  of  the  Assistant  Secretary  of  Defense, 
Washington,  D.C. , December,  1971. 

The  research  models.  Using  the  variables  given  in 
Table  3,  page  25,  the  research  models  are  written  ast 

^1  “ ®o  + **1X1  + ®2*2  + ®3X3  * ®4^4  + • • • + ®24X24 
^2  a ^ ^1^1  ®2X2  * B3X3  ^ ®4^4  ^ • • • + ®24X24 

Y3  = Bq  + + ®2X2  + B3X3  ^4^4  + ^24^24 

The  independent  variables,  through  X 22 * X23*  and  X24* 
were  chosen  because  of  the  belief  that  there  was  a relation- 
ship between  these  variables  and  the  time  a contract  remained 
open  past  the  Original  Milestone  Closing  Date.  When  calcu- 
lated, the  regression  coefficients  provide  a better 
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understanding  of  the  various  relationships  that  increase  the 
tine  a contract  is  overage. 

The  BMD02R  Stepwise  Regression  Program  was  used  to 
perform  the  regression  on  the  models.  This  program,  one  of 
a series  developed  by  the  UCLA  Biomedical  Computer  Facility, 
was  accessed  through  the  CREATE  Computer  Library  at  the 
School  of  Systems  and  Logistics,  Wright-Patterson  AFB,  Ohio. 
The  BMD02R  program i 

. . . computes  a sequence  of  multiple  linear  regres- 
sion equations  in  a stepwise  manner.  At  each  step,  one 
independent  variable  is  added  to  the  regression  equation 
. . . and  the  effects  of  the  added  variable  are  analyzed 
and  tabulated  [li233]. 

Validation  of  regression  model.  The  first  statis- 
tical test  performed  was  a test  of  significance  on  each 
research  model  regression  equation.  The  test  involved  an 
F-test  computed  at  the  .95  percent  significance  level.  The 

F-test  is  a test  of  the  statistical  significance  of  the 

2 

coefficient  of  determination,  R , of  the  regression  model. 

The  BMD02R  Regression  Program  calculated  a coefficient  of 
determination  for  each  of  the  three  regression  models, 

Y^,  Y2>  and  Y^ . The  corresponding  coefficients  of  determin- 
ation  were  labeled  (R^)  , (R2)  » and  (R^)  , respectively. 

The  coefficients  of  determination  are  a measure  of  the 
explained  variation  of  the  independent  variables  about  the 
regression  line  divided  by  the  total  variation.  The  closer 
this  value  approaches  unity,  t*vi  mu  - reliable  the  regression 
model  is  as  a description  of  t.  relationship  between  the 
dependent  and  independent  varic*ies  of  the  model.  The  F-test 


was  established  in  the  following  manner  with  Hq  as  the  null 


hypothesis,  and  as  the  alternate! 

Hqi  Bt  ■ B2  * B-j  3 B^ , ♦ • * 1 3 &24  ~ ® 

H^i  B^  f Oj  B2  t 0|  , . . . , B24  f 0 (or  any  combination) 


Using  the  previously  chosen  significance  level  of  .95,  a com- 
parison of  sample  and  critical  F values  for  each  model  was 
accomplished.  The  critical  F value  for  each  model  was  taken 
from  the  .95  F distribution  found  in  the  CRC  Standard  Math 
Tables  (7»621-626).  The  value  from  the  math  tables  is  pre- 
sented as  and  is  located  by  entering  the  table  with 

both  the  upper  and  lower  degrees  of  freedom,  v _ and 
r ^ upper 

vlower*  va^ue  of  vupper  eclual  t0  t*ie  nurokar  of  param- 

eters in  the  regression  equation  minus  one.  The  value  of 
vlower  e<lua^  t0  samPle  size  minus  the  number  of  param- 
eters in  the  regression  equation. 

The  sample  value  for  F was  calculated  by  the  regres- 
sion program.  The  general  form  of  the  calculation  of 

^sample  wa8' 


F 


sample 


(«2)/(p-d 

O - R2)/(n  - p) 


where  n **  sample  size  and  p * number  of  parameters  in  the 
research  model.  The  Fcrit  was  then  compared  with  the  f'sample< 
If  the  sample  value  of  F was  less  than  Fcrit  the  null  hypoth- 
esis could  not  be  rejected j if  the  value  of  F , was 

sample 

greater  than  Fcr^t  the  null  hypothesis  could  be  rejected  and 
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a statistical  relationship  between  the  independent  and 
dependent  variable  could  be  supported. 

Coding  of  research  hypotheses  and  research  ques- 
tions. Research  Hypotheses  One,  Two,  and  Three  will  be 
tesred  for  Overage  Categories  A,  B,  and  C.  In  addition, 
cwenty-two  variables  are  to  be  tested  in  conjunction  with 
Research  Hypothesis  Three.  To  preclude  the  necessity  of 
stating  a different  research  hypothesis  for  each  combina- 
tion of  category  type  and  variable  (a  total  of  sixty-3ix 
research  hypotheses),  each  of  the  three  research  hypotheses 
will  be  coded  to  incorporate  all  possible  combinations.  The 
code  will  specify  the  overage  category  and  variable  that  are 
associated  with  that  particular  research  hypothesis.  The 
format  for  the  research  hypotheses  follows*  Research  Hypoth- 
esis 1,  2,  or  3*  Overage  Category  A,  B,  or  Cj  Variable  to  be 
tested  (X^  - X2^)«  The  following  example  is  provided  for 
clarification*  Research  Hypothesis  3 - CX^g.  In  this 
instance,  Research  Hypothesis  Three  is  tested  for  Overage- 
Category  C in  relation  to  variable  X^g,  Termination  in  Proc- 
ess. Table  4,  pages  27  and  23,  summarizes  the  variables, 

X1  through  X27 » and  their  corresponding  explanation. 

Hypothesis  Testing.  Statistical  significance  of  the 
regression  coefficients  was  directly  related  to  the  following 
research  hypotheses* 

Researcn  Hypotheses  1 - Ax23*  Bx23l  ^23 


TO*  UWJIJ  • PIPPPP  ,P!U 


B!E 


pjppwppfpiw  iupbf  ■ 
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There  ts  a relationship  between  the  time  a contract 
is  overage  and  the  face  value  of  the  contract.  These  hypoth- 
eses are  related  to  B23X23*  the  product  of  the  face  value  of 
che  contract  multiplied  by  the  net  regression  coefficient. 

Research  Hypotheses  2 - AX24I  BX24I  ^24 

There  is  a relationship  between  the  time  a contract 
is  overage  and  the  unliquidated  obligation.  These  hypotheses 
are  related  to  B24X24'  the  product  of  the  unliquidated  obli- 
gation multiplied  by  the  net  regression  coefficient. 

Research  Hypotheses  3 - AX1-22*  BXl-22*  CXl-?2 

There  is  a relationship  between  the  time  a contract 
is  overage  and  the  reason  codes  for  overage.  These  hypotheses 
are  related  to  B-jX^,  B2X2.  83X3,  ...  , B22X22*  the  Products 
of  the  overage  reason  codes  multiplied  by  the  appropriate 
regression  coefficients. 

The  test  used  to  establish  statistical  significance 

of  the  individual  regression  coefficients  was  the  T-test. 

The  T-test  involved  a comparison  of  the  critical  value  of  t, 

Ccrit*  an<*  t*le  sun,P^e  values  of  t,  tgamp»  The  calculation 

of  the  sample  t values  was  accomplished  using  the  sample 

statistic  F^.  The  BMD02R  program  calculated  an  F term  for 

each  of  the  independent  variables  in  the  research  model. 

Those  F,  terms  were  similar  to  the  F0^„„  calculated  for  each 
1 samp 

regression  model » however,  each  F^  related  only  to  the  inde- 
pendent variable  it  was  associated  with. 
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Exampiei  F^  would  relate  to 

F2  would  relate  to  B2 

F^*  •••  1 ^24  would  relate  to  ••• 

The  statistical  test  for  the  regression  coefficients  for  the 
Independent  variables  was  accomplished  at  the  .99  level  of 
significance.  This  limit  was  chosen  to  decrease  the  proba- 
bility of  Incorrectly  rejecting  the  null  hypothesis  associ- 
ated with  each  Independent  variable.  The  null  and  the  alter- 
nate hypotheses  were  established  In  the  following  manner  1 

Hi  B.  * 0 

o 1 

Hxi  Bt  t 0 

(where  1 represents  the  values  1 through  24  corresponding  to 
each  Independent  variable).  The  CRC  Standard  Math  Tables 
were  used  to  determine  the  critical  T value,  Tcr^t  ( 7 i 617 ) • 
The  value  was  established  using  a level  of  significance  of 
.99  and  vT#  the  number  of  degrees  of  freedom.  The  value  of 
Vj  is  equal  to  the  sample  size  minus  the  number  of  parameters 
In  the  model  or  vT  =»  (n-p).  The  value  of  tcr^c  remained 
constant  for  all  24  Independent  variables.  The  next  step 
was  to  calculate  a T value  for  each  of  the  24  net  regression 
coefficients.  The  form  used  was« 


(where  l represented  the  values  1 through  24).  Similar  to 
the  F-test,  If  the  value  for  T^  was  greater  than  Tcrit  the 
null  hypothesis  could  be  rejected  which  supported  the 
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relationship  between  the  Independent  variable  and  the 
dependent  variable  either  Y^»  Y 2 » or  Y3.  If  was  less  than 
T^rit  ^ull  hypothesis  could  not  be  rejected.  Table  5, 
page  35,  presents  a summarization  of  statistical  tests. 

Those  t-tests  which  Indicated  statistical  signifi- 
cance between  the  dependent  and  Independent  variable  were 
reviewed.  A decision  rule  to  determine  the  practical  sig- 
nificance of  these  relationships  was*  An  independent  vari- 
able would  be  considered  significant  If  It  caused  the  over- 
age time  span,  Y,  to  exceed  .33  years.  This  rule  was  based 
on  the  opinion  of  an  expert  In  the  field  of  contract- 
closure,  Mr.  Donald  J.  O'Neill,  Contracting  Officer,  Acqui- 
sition Management  Information  System  Program  Office.  This 
decision  rule  was  used  to  test  the  practical  significance  of 
the  following  research  hypotheses* 

Research  Hypotheses  1 - AX231  BX23)  CX23 

There  Is  a relationship  between  the  time  span  a 
contract  Is  overage  and  the  face  value  of  the  contract. 

Research  Hypotheses  2 - AX2^i  6X24)  C*24 

There  is  a relationship  between  the  time  span  a 
contract  is  overage  and  the  unliquidated  obligation. 

Research  Hypotheses  3 - AX^^1  BXi-22l  CXl-22 

There  is  a relationship  between  the  time  span  a 
contract  is  overage  and  the  reason  codes  for  overage. 
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Table  6 summarizes  the  relationship  between  each 
research  hypothesis,  the  related  variables,  the  statistical 
test  on  the  variables,  and  the  decision  rule  which  allowed 
the  variable  to  support  the  associated  hypothesis.  Each 
research  hypothesis  was  tested  for  Overage  Categories  A,  B, 
and  L (reference  page  3l). 


Table  6 

Summary  of  Hypothesis  Testing 


Research 
Hypothesis 
and  Overage 
Category 

Related 

Variable 

Test  of 

Statistical 

Significance 

Test  for 

Practical 

Significance 

1 • AtBiC 

2 - AtBiC 

3 - AtBiC 

X23t  Face  Value 

X24i  ULO 

X,  ■>■}!  Reason 
Codes 

c23  > Ccrit 
c24  > ccrit 
cl-22>ccrit 

If  the  increase 
in  Y>  .33 
years  for  Y, 
or  Y2  or  Y3  Lthe 
hypothesis  was 
supported  (6). 

Research  Hypotheses  3 - AX^i  BX^t  ar,d  ^24  were 
used  in  consonance  with  a deterministic  equation  to  calculate 
opportunity  cost  to  test  Research  Question  One  for  Overage 
Categories  A,  B»  and  C. 


Research  Question  1 - Ai  Bj  C 


A disproportionate  amount  of  Opportunity  Cost  is 
created  by  a small  number  of  the  overage  reason  codes. 


The  deterministic  equation  used  to  calculate  oppor- 


tunity cost  is i 
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[(1  + t)n  x ULO]  - ULO  » Opportunity  Cost 

where  i * 10  percent,  the  standard  DOD  discount  rate  (17) 
and  n * overage  time  period. 

The  opportunity  cost  was  calculated  in  the  following 

manner i 

1.  The  Unliquidated  Amount  (ULO),  time  overage,  and 
the  reason  code  were  sorted  from  the  existing  decks  of  key- 
punched computer  cards  containing  the  data  for  the  regression 
analysis • 

2.  The  opportunity  cost  was  computed  using  the  pre- 
viously described  opportunity  cost  equation.  These  costs 
were  then  summed  by  both  reason  code  and  contract  category. 

The  decision  rule  used  to  test  Research  Question  One 
is  explained  in  the  following  manner.  Research  Question  One 
will  be  practically  significant  ifi  (1)  a group  of  statis- 
tically significant  reason  codes  which  account  for  less  than 
fifty  percent  of  the  twenty-two  overage  reason  codes  is 
identified,  and  (2)  that  group  of  reason  codes  is  responsible 
for  more  than  fifty  percent  of  the  total  opportunity  cost  for 
that  category  of  contracts. 


CHAPTER  III 


DATA  ANALYSIS 


Overview 

The  data  analysis  focused  on  four  major  areas.  The 
data  base  is  summarized  according  to  the  contracts  that  were 
included  in  the  study  and  those  contracts  that  were  omitted 
from  the  study.  Second,  a statistical  evaluation  of  the 
general  regression  models  is  accomplished.  This  section  of 
the  chapter  also  presents  a sample  application  of  the 
regression  model.  Third,  the  coefficient  validation  matrices 
are  presented  to  explain  the  statistical  significance  of  the 
variables  that  represent  overage  reason  codes.  Finally,  the 
opportunity  cost  associated  with  these  reason  codes  is  cal- 
culated. 

The  assumptions  and  limitations  that  constrained  this 
study  are  also  presented  in  this  chapter. 

Disposition  of  Data  Base 

The  research  for  this  study  originally  involved  the 
analysis  of  1359  overage  contracts.  However,  as  the  study 
progressed  the  data  base  decreased  to  a total  of  888  con- 
tracts. A summary  of  the  contracts  deleted  from  the  data 
base  is  presented  in  Appendix  E.  The  reasons  for  deletion 
fall  into  three  categories! 
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1.  There  were  438  contracts  deleted  from  the  data 
base  because  no  overage  reason  code  was  annotated  on  the 
Contract  Status  Report. 

2.  All  contracts  with  face  value  of  more  than  three 
standard  deviations  away  from  the  mean  were  deleted  from  the 
data  base.  These  contracts  were  omitted  to  Insure  that  the 
average  face  value  of  contracts  used  In  this  study  provided 
a representative  measure  of  central  tendency  (20il4-l7). 

Nine  contracts  were  deleted  from  the  data  base  for  this 
reason. 

3.  Twenty-four  contracts  were  deleted  from  the  data 
base  because  no  Information  was  available  on  the  length  of 
time  these  contracts  had  been  overage. 

The  33  contracts  that  were  deleted  from  the  data  base  for 
reasons  two  and  three,  above,  generally  have  a large  ULO 
balance.  Management  attention  to  this  group  of  contracts 
might  yield  substantial  savings. 

Table  7,  page  40,  provides  summary  data  concerning 
the  contracts  which  were  Included  in  this  study.  The  major- 
ity of  contracts  which  were  included  are  Category  C con- 
contracts.  Also,  the  "C"  contracts  had  the  largest  average 
ULO  and  the  longest  average  time  overage.  Table  8,  page  40, 
Is  presented  to  provide  the  reader  with  further  information 
concerning  the  total  dollar  values  involved. 
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Table  7 

Summary  of  Contracts  Included  in  Study 


Summary 

Statistic 

A 

Category  Type 
B 

C 

# in  the 
Category 

12 

79 

797 

Mean  Face 
Value 

$ 

664.00 

$ 994,361.00 

$ 

3,764,672.00 

Total  Face 
Value 

$7 

,968.00 

$78,554,519.00 

$3 

,000,443,584.00 

Mean  ULO 

$ 

1.00 

$ 10,732.00 

$ 

11,455.00 

Total  ULO 

S 

12.00 

$ 847,865.00 

$ 

9,129,674.00 

Mean  Time 
Overage 

1 

.04  yr. 

1.50  yr . 

2.19  yr. 

Table  8 

Data  Base  Total  Dollar  Values 

Included 

Deleted 

Total 

Number  of 

Contracts 

888 

471 

1359 

% of  Total 

65% 

35% 

100% 

Face  Value 

$3,079,006,071 

$6,847,709,650 

$9,926,715,721 

% of  Total 

31% 

69% 

100% 

ULO 

$9,997,551 

$9,975,357 

$19,972,908 

% of  Total 

50.1% 

49.9% 

h— * 

o 

o 

41 


General  Regression  Models 

Results  of  the  compilation  and  processing  of  all 
relevant  data  using  the  BMD02R  Regression  Program  are  shown 
in  the  output  of  the  following  three  equations! 

Cfltefipra,  A 

Y1  “ B0  + B6X6  + B19X19  + E20X20  + B2lX21 
+ B23X23  + B24X24 

Category  B 

Y2  * B0  + B1X1  + B2X2  + B4X4  + BgXg  + B9X9 

+ B10X10  + B12X12  + B15X1 5 + Bl7Xl7  + B18Xl8 

+ b19x19  + b20X2Q  + B21X21  + B23X23  + B24X24 
Category  C 

y3  * B0  + b1x1  + b2x2  + b4x4  + b5x5  + b6x6  + b7x7 

+ BgXg  + B9X9  + BioXlO  + B12X12  + B13X13 
+ B14X14  + B1 5X1 5 + B1 7Xl7  + B20X20  + B21X21 
+ B22X22  + B23X23  * B24X24 


The  equations  correspond  to  the  three  categories  of 
contracts,  respectively.  Some  of  the  reason  code  variables 
defined  for  this  study  are  not  included  in  tne  equations 
because  they  were  not  observed  in  the  original  data.  The 
values  of  each  of  the  HB^"  coefficients  may  be  found  in 
Table  9,  pages  43-44,  beneath  the  respective  category  type. 
It  should  be  noted  that  variables  X- 
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Face  Value  and  X 
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Unliquidated  Obligation*  have  been  scaled  down  by  factors  of 

$1,000*000  and  $1,000,  respectively.  Therefore,  in  order  to 

use  these  coefficients  to  calculate  the  average  time  span, 

it  is  necessary  to  divide  the  Face  Value  by  $1,000,000  and 

the  ULO  by  $1,000,  respectively.  A sample  calculation  is 

presented  following  Table  9. 

One  of  the  important  factors  of  any  regression  model 

is  the  extent  to  which  it  explains  the  variance  of  the 

dependent  variable,  "Y^ . " The  measure  of  the  power  of  this 

2 

explan?r^on  is  found  in  the  value  R , and  its  corresponding 

measure  of  statistical  significance,  "F."  Values  for  R^, 

the  coefficient  of  determination,  and  "F"  are  presented  at 

the  bottom  of  Table  9 for  each  category  type.  A review  of 

2 

these  figures  indicates  that  the  R term  for  both  category 
"B"  and  "C"  contracts  is  low.  However,  the  MF"  value  for 
each  of  these  equations  exceeds  the  critical  "F"  value  cal- 
culated at  the  .95  level  of  significance.  This  indicates 
that  the  total  amount  of  variation  explained  by  the  chosen 
variables  was  relatively  low.  However,  the  statistical  sig- 
nificance of  these  variables  is  high,  and  they  are  important 
in  explaining  the  closure  process. 

In  the  case  of  the  Category  A contracts , the  of 
.9688  and  "F"  value  of  4.39  suggests  a strong  predictive 
equation.  It  should  be  noted  that  due  to  limitations  in  the 
data,  only  12  contracts  were  included  in  the  sample.  Since 
12  contracts  are  not  a representative  sample,  further  ref- 
erence to  Category  A contracts  will  be  limited. 
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Sample  Application  of  the  Regression  Model 

To  facilitate  the  understanding  of  the  regression 
models  used, the  following  example  is  presented.  Assume  a 
contract  with  the  following  properties  has  just  gone  overage i 
Contract  Typei  C 

Overage  Reason  Codei  M (Calculation  of  Overhead  Rates) 
Face  Valuei  $23,400,000.00 
ULOi  $1,500.00 

The  Category  C model  would  be  chosen,  and  the  above 
values  would  be  substituted  into  their  respective  varieble 
positions.  All  other  variables  would  be  set  equal  to  zero. 
The  resultant  general  form  of  the  computation  would  bet 

Y3  - B0  + BUX12  + B23X23  + B24X24 

Remembering  to  scale  the  Face  Value  and  the  ULO  by  1,000,000 
and  1,000  respectively,  and  using  the  coefficient  values 
found  on  Table  9,  pages  43-44,  the  computational  equation  is 
written  ast 

Y3  = (.88)  r ( .81) (1)  + ( ,01)(23.4)  + (-.003)(1.5) 

* 1.9195  yrs . 

It  is  possible  to  infer  from  this  value  that,  given  normal 
management  practices,  this  contract  would  remain  overage  for 
approximately  1.9  years.  This  figure  is  of  course  subject 
to  many  management  factors  which  could  either  lengthen  or 
shorten  the  overage  period.  With  this  in  mind,  it  seems 
appropriate  to  discuss  the  statistical  significance  of  the 
individual  regression  coefficients. 
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The  matrices  illustrated  in  Tables  10  and  11,  pages 
48  and  49,  present  the  significant  statistical  and  practical 
relationships  between  all  the  regression  coefficients  used 
in  the  Category  B and  C regression  models.  These  matrices 
are  valuable  when  predicting  and  comparing  the  overage  time 
span  of  two  Category  B or  C contracts  with  equal  ULO  and 
face  value,  but  different  reasons  for  being  overage.  The 
following  explanation  will  clarify  the  use  of  this  table. 

The  reason  code  at  the  end  of  the  row  and  at  the  top 
of  the  column  should  correspond  to  the  reason  codes  of  the 
overage  contracts  for  which  the  comparison  is  being  made. 

Find  the  row  reason  code  i.nat  corresponds  to  the  reason  that 
is  causing  one  of  the  overage  contracts  to  remain  overage. 
Scan  across  that  row  of  •:?.  ? matrix  until  the  column  reason 
code  of  the  other  contract  is  reached.  If  there  is  a value 
at  the  intersection  of  the  row  and  column,  the  number  may  be 
interpreted  as  the  time  difference  that  will  exist  between 
the  closing  dates  of  the  two  contracts  being  compared.  The 
sign  of  the  number  indicates  which  contract  will  close  first. 
A negative  sign  indicates  that  the  contract  annotated  with 
the  column  reason  code  will  close  earlier  than  the  other 
contract,  A positive  value  indicates  that  the  contract 
annotated  with  the  column  reason  code  will  close  later  than 
the  other  contract.  If  there  is  no  value  at  the  intersection 
of  the  row  and  the  column,  no  comparison  can  be  made.  This 
does  not  mean  that  a time  difference  does  not  exist.  It 


gi.lPM  I TMW  ll.i  m?l  WW 


m m'  \m  w.  w pppppip  \*mw 


s 

t 


i 


[ 

l 

t 


J 


■w 


47 

merely  indicates  that  the  time  difference  between  the  reason 
codes  could  not  be  statistically  supported  by  the  observa- 
tions collected  for  this  study. 

The  rows  of  the  matrices  that  are  annotated  with 
double  stars  indicate  reason  codes  that  may  be  holding  con- 
tracts overage  longer  than  other  reason  codes  observed.  It 
is  not  possible  to  state  with  certainty  that  these  are  the 
reason  codes  that  are  keeping  overage  contracts  open.  How- 
ever, the  negative  signs  that  consistently  appear  across  the 
row  indicate  that  a specific  reason  code  does  have  a tendency 
to  keep  a contract  open  for  longer  periods  of  time  than 
other  reason  codes.  A review  of  Tables  10  and  11,  pages  48 
and  49,  shows  thati  (1)  reason  codes  D,  S,  and  T tend  to 
cause  Category  B contracts  to  be  overage  longer  than  the 
other  reason  codes,  and  (2)  reason  codes  A,  H,  N,  Q,  S,  and  X 
tend  to  cause  Category  C contracts  to  be  overage  longer  than 
the  other  reason  codes. 

Category  A Contracts 

There  were  only  12  valid  observations  concerning  the 
Category  A contracts.  Further  analysis  of  this  category  was 
not  accomplished  because  any  inferences  made  from  such  a 
small  sample  would  not  be  valid.  A coefficient  validation 
matrix  was  not  constructed  nor  were  opportunity  cost  calcu- 
lations accomplished  for  Category  A contracts.  The  combi- 
nation of  Category  A contracts  and  Category  B contracts  into 
one  cell  was  considered.  However,  it  was  decided  that  this 
combination  would  bias  the  Category  B contracts . 


^Reason  codes  having  a tendency  to  increase  overage  time  spans 
**Values  in  the  matrix  represent  overage  time  spans. 


overape  time  span 
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Effect  of  Category  Type  on 
Overage  Time  Span 

To  test  the  effect  of  contract  type  on  overage  time 
span,  a regression  analysis  was  performed  on  the  888  con- 
tracts included  in  this  study.  A T-test  was  performed  on  the 
variables  that  represented  contract  type.  This  test  indi- 
cated that  a C Category  contract  has  a tendency  to  remain 
overage  longer  than  a B Category  contract.  For  example,  if 
a B Category  contract  and  a C Category  contract  of  equal 
face  value,  l)L0,  and  coded  with  the  same  overage  reason  code 
were  compared,  the  C Category  contract  would  be  overage  .93 
years  longer  than  the  B Category  contract. 

Analysis  of  Opportunity  Cost 

Opportunity  cost  was  calculated  for  each  overage 
reason  code  for  both  Category  B and  Category  C contracts. 
Appeidix  C presents  the  ULO,  opportunity  cost,  and  the  number 
of  observations  for  each  overage  reason  code  in  Category  B 
and  Category  C.  This  analysis,  however,  will  address  only 
those  reason  codes  in  Categories  B and  C that  were  discussed 
on  page  47.  These  were  the  reason  codes  in  each  category 
that  had  a tendency  to  keep  contracts  overage  longer  than 
other  reason  codes.  Table  12,  page  51,  presents  a summary 
of  the  opportunity  cost  that  was  calculated  for  the  three 
reason  codes  identified  in  Category  B. 

Reason  codes  S and  T represent  six  percent  of  the 
total  ULO  and  four  percent  of  the  total  opportunity  cost. 
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Table  12 

Opportunity  Cost--Category  B 


V. 

f 

Number 

Unliquidated 

Opportunity 

r 

Reason 

of 

Obligation 

Cost 

s * 

r 

Code 

Observations 

(Dollars) 

(Dollars) 

* 

1 

! 

D 

6 

0 

0 

\ 

S 

2 

4,550 

1 ,409 

>i 

T 

5 

49,867 

3,288 

\ 

$ 

All 

Other 

66 

793  ,448 

111 ,884 

t 

( 

Total 

79 

847,865 

116,581 

( 

\ 

y 

* 

Six  reason  codes 

in  Category  C were 

identified  as 

having 

a tendency  to  keep  contracts  overage 

longer  than  other 

reason 

codes  observed. 

Table  13  summarizes 

the  opportunity 

cost  attributed  to  these  contracts. 


Table  13 

Summary  of  Category  C Opportunity  Cost- 

Number  Unliquidated  Opportunity 

Reason  of  Obligation  Cost 

Code  Observations  (Dollars)  (Dollars) 


A 

108 

1 ,098,933 

359,322 

H 

17 

606,877 

105,215 

N 

7 

281 

111 

Q 

97 

1,116,997 

181 ,960 

s 

102 

888,460 

244,095 

X 

2 

851  ,021 

278.115 

All 

Other 

464 

4,567,105 

618,188 

Total 

i 

797 

9,129,674 

1 ,787,006 
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Reason  codes  A,  H,  N,  Q.  S,  and  X represent  fifty 
percent  of  the  total  ULO  and  sixty-five  percent  of  the  total 
opportunity  cost  associated  with  Category  C contracts. 

Table  14  summarizes  all  opportunity  cost  incurred  by 
the  overage  contracts  that  were  listed  in  the  28  February 
1975  Contract  Status  Report.  This  summary  is  divided  into 
two  sections i (1)  contracts  that  are  included  in  the  data 
base  for  this  study*  and  (2)  contracts  deleted  from  the 
data  base  due  to  lack  of  information.  It  is  important  to 
note  that  twenty-four  C Category  contracts , with  a ULO 
totaling  $5,300,594,  are  not  included  in  this  summary  because 
it  was  not  possible  to  determine  how  long  these  contracts  had 
been  overage.  A negative  ULO  of  $3,157,074  is  included  in 
the  $5,300,594.  This  figure  was  included  in  the  calculation 
because  there  is  an  opportunity  cost  associated  with  ULO 
whether  the  idle  funds  are  in  the  hands  of  the  government  or 
the  contractor.  A summary  of  these  contracts  is  presented  in 
Appendix  D. 


Table  14 


Total  Opportunity  Cost  Incurred 


Category 

Type 

Included 
(Dollars ) 

Deleted 
(Dollars ) 

Total 
(Dollars ) 

A 

1 

139 

140 

B 

116,581 

11,238 

127,819 

C 

1,787,006 

924,469 

2,711,475 

All 

Contracts 

1,903,588 

935,846 

2,839,434 
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Of  the  1359  contracts  tn  the  original  data  base,  It 
was  possible  to  calculate  opportunity  costs  on  1335  contracts. 
Twenty-four  C Category  contracts  lacked  the  information 
needed  to  calculate  an  overage  time  span  necessary  for  oppor- 
tunity cost  calculations.  The  888  contracts  used  in  this 
study  incurred  67  percent  of  the  total  opportunity  cost. 

Summary  of  Assumptions 

The  following  assumptions  were  made  so  that  this 
study  could  be  accomplished! 

1.  The  28  February  1975  Contract  Status  Report 
reflected  the  most  current  reason  code  for  the  contract 
remaining  overage. 

2.  The  unliquidated  obligation  for  each  contract  is 
an  average  value  for  the  overage  time  span.  The  maximum 
value  occurs  when  the  contract  is  physically  completed  and 
the  minimum  value  occurs  when  the  contract  is  finally  closed. 

3.  The  administration  of  contracts  within  AFCMD  is 
uniform  for  each  AFPRO. 

A.  The  transfer  of  all  data  elements  from  the  CSR 
to  the  computer  inputs  for  the  BMDG2R  Stepwise  Regression 
Model  was  precise. 

5.  All  of  the  assumptions  necessary  to  perform 
regression  have  been  fulfilled. 

6.  The  distribution  of  the  mean  face  values  of  the 
Monthly  Contract  Status  Report  are  assumed  to  be  normal . 

7.  All  overage  contracts  administered  by  AFCMD  are 
listed  in  the  Physically  Complete  Section  of  the  CSR. 
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8.  The  reason  code  listed  on  the  CSR  represents  the 
one  and  only  reason  the  contract  is  in  the  overage  status. 

SummaryofLlmitatlons 

The  limitations  of  this  study  are  as  follows i 

1.  Conclusions  will  be  limited  to  those  contracts 
which  are  defined  in  che  population. 

2.  The  models  developed  are  descriptive  in  nature 
and  reflect  only  those  interactions  which  the  BMD02R  model 
is  able  to  compute.  The  fact  that  the  regression  equations 
are  models  restricts  their  use  in  real  world  application. 

3.  All  predictions  or  inferences  will  be  based  on 
decision  rules  and  are  not  in  any  way  meant  to  be  derogatory 
or  critical  of  present  management  practices. 

4.  It  is  not  known  whether  the  reason  code  on  the 
Contract  Status  Report  reflects  the  reason  the  contract  went 
overage  or  is  the  reason  the  contract  is  presently  overage. 

5.  More  than  one  overage  reason  code  was  reflected 
for  272  contracts.  The  initial  reason  listed  in  the  CSR  was 
arbitrarily  selected  for  inclusion  in  the  regression  model. 

6.  A substantial  number  of  contracts  reported  in 
the  CSR  lacked  sufficient  data  to  be  included  in  the  study. 
Most  conspicuous  was  the  absence  of  overage  reason  codes  for 
438  contracts. 

7.  A total  of  nine  high  value  contracts  were  deleted 
because  their  face  value  was  greater  than  three  standard 
deviations  away  from  the  mean  face  value. 
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8.  The*  models  do  not  meet  the  assumption  of  ran- 
domness for  the  error  terms  of  the  dependent  variable* 

9,  Where  the  Revised  Milestone  Closing  Date  has 
been  exceeded  and  not  updated,  the  28  February  1975  report 
date  was  used  to  calculate  the  overage  time  span. 

10.  Where  the  Original  Milestone  Closing  Date  had 
been  exceeded  and  no  Revised  Milestone  Closing  Date  had  been 
annotated,  the  28  February  1975  report  date  was  used  to  cal- 
culate the  overage  time  span. 


CHAPTER  IV 


P 


STATISTICAL  AND  PRACTICAL  SIGNIFICANCE 
OF  RESEARCH  HYPOTHESES 


Introduction 

This  chapter  relates  the  findings  of  Chapter  III  toi 
Research  Hypotheses  1 - BX23S  CX23 
Research  Hypotheses  2 - CX24 

Research  Hypotheses  3 - BX,_22;  ^1-22 

Research  hypotheses  related  to  Category  A are  not 
discussed  in  this  chapter.  There  was  an  insufficient  number 
of  observations  to  form  a valid  sample  for  Category  A (ref- 
erence page  47,  Category  A Contracts). 

The  format  for  presentation  of  Research  Hypotheses 
1 - BX23I  CX23  and  Research  Hypotheses  2 - BX24S  CX24  is 
similar.  The  research  hypothesis  is  stated,  the  tests  for 
statistical  and  practical  significance  are  illustrated,  and 
the  results  of  these  tests  are  discussed.  The  presentation 
of  Research  Hypotheses  3 - BX}.22!  CXl-22'  howev€rt  does  not 
follow  the  same  format.  The  large  number  of  research  hypoth- 
eses required  that  they  be  summarized  according  to  those 
hypotheses  that  were  supported  and  those  hypotheses  that  were 
not  supported  for  Categories  B and  C.  A summary  of  research 
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hypotheses  test  results  is  presented  in  Table  17 , page  7l. 

A test  of  practical  significance  of  Research  Question 
1 - Bi  C follows  the  summary  of  the  research  hypotheses. 


Research  Hypotheses  Related  to  Face  Value 


Research  Hypotheses  1 - BX23I  CX23 


There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  face  value  of  the  contract. 

Findings 

The  test  of  statistical  significance  performed  on  the 
face  value  variable,  X23»  was  the  T-test.  The  null  and  the 
alternate  lypotheses  for  this  T-test  werei 


X 

0 

b23  = 0 

Hl* 

b23  + 0 

The  null  was  rejected  only  if  t_„  > t . at  a significance 

s amp  crxi. 

level  of  .99.  The  sample  values  and  critical  values  of  t 
for  the  research  hypotheses  weret 


BX23 

tc,mn  = .512 

samp 

tcrit 

OC23 

t _ = 2.798 
samp 

tcrit 

2.657 

2.576 


The  above  comparison  shows  that  there  is  no  statistical  sig- 
nificance for  Category  B contracts.  Therefore,  Research 
Hypothesis  1 - BX23  cannot  be  supported.  Research  Hypothesis 
1 - CX23»  on  the  other  hand,  is  statistically  significant  and 
the  null  hypothesis  can  be  rejected.  The  rule  of  practical 
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significance  is  then  applied.  This  rule  states i An  inde- 
pendent variable  is  considered  to  be  practically  significant 
if  it  increased  the  overage  time  span  by  at  least  .33  years 
(reference  page  34).  Therefore,  only  contracts  with  a face 
value  of  $25.4  million,  or  more,  should  be  considered  prac- 
tically significant. 


Research  Hypotheses  Related  to 
Unliquidated  Obligation 

Research  Hypotheses  2 - :x24;  cx2,, 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  unliquidated  obligation. 

Findings 

The  test  for  statistical  significance  of  the  ULO 
variable,  X ^ is  also  the  T-test.  The  null  and  the  alter- 
nate hypotheses  are  represented  as i 


Ho‘ 

B24 

o 

it 

H1‘ 

B24 

f 0 

Once  again,  the  null  was  rejected  only  if  > t . _ at 

J sai.ip  cnt 

a significance  level  of  .99.  The  sample  and  critical  values 
of  t for  the  research  hypotheses  werei 


2 - BX2,4 

csar»p  = 

c 

cnt 

2 - r-'X2/) 

'samp  ' 

t 

mt 

= 2.657 
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The  above  comparison  shows  tha ' for  Category  B contracts  ULO 
is  not  statistically  significant*  Therefore,  Research  Hypoth- 
esis 2 - ®^24  cannot  *>e  supported.  Research  Hypothesis 
2 - on  the  other  hand,  is  statistically  significant, 

and  the  null  hypothesis  can  be  rejected.  Again,  applying  the 
rule  of  practical  significance  for  independent  variables, 
Category  C contracts  which  have  an  unliquidated  obligation 
of  $108,600  should  be  considered  practically  significant. 

Statistical  and  Practical  Significance  of 
Reason  Code  Research  Hypotheses 

The  test  used  to  establish  statistical  significance 

for  Category  B and  Category  C Reason  Code  Research  Hypotheses 

was  the  T-test.  The  null  and  the  alternate  hypotheses  for 

this  test  were  established  in  the  following  manner! 

V B1*° 

Hji  t 0 

where , 

i = 1,2,4,6,10,17,18,19.20,21  for  Category  B Contracts 

i * 1,2,4.5,6,8,9,10,12,13,14.15.17,19,20,22  for 
Category  C Contracts 

For  each  of  the  above  hypotheses,  tsamp  > tcr^t»  therefore, 

Hq  was  rejected  at  a significance  level  of  *99.  The  value 
of  Ccrj^t  for  Category  B is  2*657.  The  value  of  tcr^t  for 
Category  C is  2.576.  T for  each  T-test  is  presented  with 

Sol  Tup 

the  respective  research  hypothesis. 
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In  addition  to  being  statistically  significant*  all 
of  the  research  hypotheses  presented  below  were  deemed  to  be 
practically  significant,  the  decision  rule  for  practical 
significance  follows*  a reason  code  is  considered  to  be 
practically  significant  if  it  caused  the  overage  time  span 
to  exceed  .33  years.  An  expert  in  the  field  of  contract- 
closure  has  stated  that  the  "unofficial " administrative 
grace  period  is  .33  years  (6). 

Support  of  Category  B Reason  Code 
Research  Hypotheses 

Research  Hypothesis  3 - BX^ 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  A. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  A is  compared  to 
a contract  with  overage  reason  code  T.  Tsa  for  the  respec- 
tive comparison  was  3,21. 

Research  Hypothesis  3 - BX2 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  B. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  B is  compared  to 
a contract  with  overage  reason  code  T.  Tgamp  for  the  respec- 
tive comparison  was  3,16, 
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Research  Hypothesis  3 - BX^ 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  D. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  D is  compared  to 
a contract  with  overage  reason  code  F.  Tsamp  for  the  respec- 
tive comparison  was  3.14. 

Research  Hypothesis  3 - BXg 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  F. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  F is  compared  to 
a contract  with  any  one  of  the  following  overage  reason 
codes i D,  S,  or  T.  Tgan.p  for  the  respective  comparisons 
was i 3.14,  2.80,  and  4.19. 


Research  Hypothesis  3 - BX^q 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  K. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  K is  compared  to 
a contract  with  overage  reason  code  T.  Tgamp  for  the  respec- 
tive comparison  was  3.60. 

Research  Hypothesis  3 - BX,y 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  S. 
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This  relationship  Is  statistically  significant  when 
a contract  coded  with  overage  reason  code  S Is  compared  to  a 
contract  with  overage  reason  codes  F or  W.  Tgamp  for  the 
respective  comparisons  was  2*80  and  2.68. 

Research  Hypothesis  3 - BX^g 

There  is  a relationship  between  the  time  span  a con- 
tract i 8 overage  and  the  overage  reason  code  T. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  T is  compared  to  a 
contract  with  any  one  of  the  following  overage  reason  codes » 
A,  B,  F,  K,  U,  V,  or  W,  Tgamp  for  the  respective  comparisons 
wasi  3.10,  2.82,  4.20,  3.23,  3.62,  3.20,  and  4.04. 

Research  Hypothesis  3 - BX^g 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  l). 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  U is  compared  to 
a contract  with  overage  reason  code  T.  Tgan)p  for  the  respec- 
tive comparison  was  3.52. 

Research  Hypothesis  3 - BX2Q 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  V. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  V is  compared  to  a 
contract  with  overage  reason  code  T.  ^samp  for  the  respec- 
tive comparison  was  3.15, 
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Research  Hypothesis  3 - BX21 

There  Is  a relationship  between  the  time  span  a con- 
tract Is  overage  and  the  overage  reason  code  W. 

This  relationship  Is  statistically  significant  when 
a contract  coded  with  overage  reason  code  W Is  compared  to  a 
contract  with  any  one  of  the  following  overage  reason  codes  1 
D,  S,  or  T.  Tgamp  for  the  respective  comparisons  wasi  2.84, 
2.68,  and  4.03. 

Support  of  Category  C Reason  Code 
Research  Hypotheses 

Research  Hypothesis  3 - CX^ 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  A. 

This  relationship  is  statistically  significant  when 
a contract:  coded  with  overage  reason  code  A is  compared  to 
a contract  with  any  one  of  the  following  overage  reason 
codest  B»  D,  E,  F,  J,  K,  M,  P,  Q,  S,  U,  or  V.  Tgan)p  for  the 
respective  comparisons  wasi  2.78,  3.65,  9.23,  6.73,  2.59, 
6.15,  11.47,  6.33,  6.55,  4.64,  7.91,  and  3.80. 

Research  Hypothesis  3 - CX2 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  B. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  B is  compared  to 
a contract  with  overage  reason  code  A.  Tsanip  for  the  respec- 
tive comparison  was  2,78. 


ipp  i jii rw Wff  i.  11 
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Research  Hypothesis  3 • CX^ 

There  is  a relationship  between  the  time  span  a con* 
tract  is  overage  and  the  overage  reason  code  D. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  D is  compared  to 
a contract  with  overage  reason  code  A*  Tsafflp  for  the 
respective  comparison  was  3,65, 


Research  Hypothesis  3 - CXg 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  E, 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  E is  compared  to 
a contract  with  any  one  of  the  following  overage  reason 
codesi  A,  H,  N,  Q,  S,  or  X,  Tgamp  for  the  respective  com- 
parisons wasi  9.23,  5.02,  2.74,  4.31,  5,91,  and  2.67. 

Research  Hypothesis  3 - CX^ 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  F. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  F is  compared  to 
a contract  with  any  one  of  the  following  overage  reason 
codes i A,  H,  Q,  or  S.  Tsan)p  for  the  respective  comparisons 
wasi  6.73,  4.05,  2,72,  and  3,92. 

Research  Hypothesis  3 - CXg 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  H. 
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This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  H is  compared  to  a 
contract  with  any  one  of  the  following  overage  reason  codes* 
E,  F,  K,  M,  P,  or  U*  Tsamp  for  the  respective  comparisons 
was*  5.02,  4.05,  3.55,  4.08,  3.51,  and  4.76. 

Research  Hypothesis  3 - CX^ 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  J. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  J is  compared  to 
a contract  with  overage  reason  code  A.  Tsa  for  the  respec- 
tive comparison  was  2,59. 

Research  Hypothesis  3 - CX^q 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  K. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  K is  compared  to 
a contract  with  any  one  of  the  following  overage  reason 

codes i A,  H,  or  S.  T____  tor  the  respective  comparisons 

s amp 

was i 6.15,  3.55,  and  3.35. 

Research  Hypothesis  3 - CX^ 

There  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  M. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  M is  compared  to  a 
contract  with  any  one  of  the  following  overage  reason  codes* 
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A i H,  Q*  and  S.  T_om_  for  the  respective  comparisons  wasi 

s amp 

11.47,  4.08,  3.23,  and  5.69. 

Research  Hypothesis  3 - CX^ 

there  is  a relationship  between  the  time  span  a con- 
tract is  overage  and  the  overage  reason  code  N. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  N is  compared  to 
a contract  with  any  one  of  the  following  overage  reason 
codes i E or  U.  T8amp  for  the  respective  comparisons  was 
2.74  and  2.73. 

Research  Hypothesis  3 - CX-j^ 

There  is  a relationship  between  the  time  span  a 

contract  is  overage  and  the  overage  reason  code  P. 

This  relationship  is  statistically  significant  when 

a contract  coded  with  overage  reason  code  P is  compared  to 

a contract  with  any  one  of  the  following  overage  reason 

codes i A,  H,  or  S.  T for  the  respective  comparisons 

s amp 

was i 6.33,  3.51,  and  3.34. 

Research  Hypothesis  3 - CX^  5 

There  is  a relationship  between  the  time  span  a 
contract  is  overage  and  the  overage  reason  code  Q, 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  Q is  compared  to 
a contract  with  any  one  of  the  following  overage  reason 

codes t A,  E,  F,  M,  or  U.  Tsamp  for  the  respective  compari- 
sons was  1 6.55,  4.31,  2.72,  3.23,  and  3.81, 
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Research  Hypothesis  3 - CX^ 

There  is  a relationship  between  the  time  span  a 
contract  is  overage  and  the  overage  reason  code  S. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  S is  compared  to 
a contract  with  any  one  of  the  following  overage  reason 
codes i A,  E,  F,  K,  M,  P,  or  U.  ^samp  f°r  the  respective 
comparisons  wasi  4.64,  5.91,  3,92,  3.35,  5.69,  3.34,  and 
4.05. 

Research  Hypothesis  3 - CX^ 

There  is  a relationship  between  the  time  span  a 
contract  is  overage  and  the  overage  reason  code  U. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  U is  compared  to 
a contract  with  any  one  of  the  following  overage  reason 
codes i A,  H,  N,  Q,  S,  or  X.  Te_m_  for  the  respective  com- 
parisons  wasi  7.91,  4,76,  2.73,  3.81,  4.05,  and  2.66. 

Research  Hypothesis  3 - CX2Q 

There  is  a relationship  betweer  rhe  time  span  a 
contract  is  overage  and  the  overage  reason  code  7. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  V is  compared  to 
a contract  with  overage  reason  code  A.  T„„  for  the 
respective  comparison  was  3,80. 
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Research  Hypothesis  3 - CX22 

There  is  a relationship  between  the  time  span  a 
contract  is  overage  and  the  overage  reason  code  X. 

This  relationship  is  statistically  significant  when 
a contract  coded  with  overage  reason  code  X is  compared  to 
a contract  with  any  one  of  the  following  overage  reason 
codes  1 E or  U,  ^samp  ^or  t^e  resPect*-ve  comparisons  was 
2.67  and  2*66. 


Statistical  Test  of  Research  Hypotheses 
Not  Supported 

The  test  used  to  indicate  statistical  significance 
was  the  l'-test.  The  null  and  alternate  hypotheses  for  this 
test  were  established  in  the  following  manner 1 


H0*  ®i  “ 0 


Hx»  Bt  + 0 


where, 

i = 8,9,12,15  for  Category  B Contracts 

i = 7,21  for  Category  C Contracts 

For  each  oT  the  above  hypotheses,  t < t . therefore, 

oainp  cru 

Ho  was  not  rejected.  The  value  of  t ^ for  Category  B 
remains  2.657.  The  value  of  t for  Category  C remains 
2.576.  ^samp  ^or  each  of  the  research  hypotheses  not  sup- 
ported was  less  than  tcr^t.  The  value  of  tcr^t  was  estab- 
lished at  the  .99  level  of  significance. 
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Twelve  of  the  twenty-two  Category  B overage  reason 
codes  were  not  statistically  significant.  Therefore,  the 
research  hypotheses  for  these  reason  codes  could  not  be  sup- 
ported, There  were  no  observations  for  eight  of  the  twelve 
research  hypotheses  not  supported.  Table  15  presents  the 
research  hypotheses  that  were  not  supported. 


Table  15 

Non-Support  of  Category  B Reason  Code 
Research  Hypotheses 


Research  Hypothesis  3 - 


Overage  Reason  Code 


where 


- No  Observations 

- No  Observations 

- No  Observations 


- No  Observations 


- No  Observations 

- No  Observations 


- No  Observations 

- No  Observations 


Non-Support  of  Categoi 
Research  Hypotheses 


n Code 


Six  of  the  twenty-two  Category  C overage  reason 
codes  were  not  statistically  significant.  Therefore,  the 
research  hypotheses  for  these  reason  codes  could  not  be 


£££nS2353?£5 
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supported.  There  were  no  observations  for  four  of  the  six 
research  hypotheses  not  supported.  Table  16  presents  the 
research  hypotheses  that  were  not  supported. 


Table  16 

Non-Support  of  Category  C Reason  Code 
Research  Hypotheses 


Research  Hypothesis  3 - CX^ 

Overage  Reason  Code 

where  i * 3 

C - No  Observations 

7 

G 

11 

L - No  Observations 

16 

R - No  Observations 

18 

T - No  Observations 

21 

W 

Summary  of  Research  Hypotheses 

Table  17,  page  71,  presents  a summary  of  Research 
Hypotheses  1 through  24  for  Category  B and  Category  C con- 
tracts. For  Category  B contracts,  ten  of  the  variables  were 
statistically  significant,  eight  variables  had  no  observa- 
tions, and  six  variables  showed  no  siatistical  significance. 
For  Category  C rontraeis,  eighteen  nf  t ho  variables 
wore  statist i cal  1 y significant,  lour  variables  had  no  obser- 
vations, and  two  variables  showed  no  statistical  signifi- 


cance 
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Table  17 

Summary  of  Research  Hypotheses  Test  Results 


Variable 

Name 

Research 

Hypothesis 

Category  B(tf) 
Reject  No  Reject 

Category  C(?0 
Reject  No  Reject 

Face 

Value 

1 - #X? 3 

0 

X 

ULO 

2 - #X24 

0 

X 

A 

3 - ifXx 

X 

X 

B 

3 - ty.2 

X 

X 

C 

3 - tfX3 

* 

k 

D 

3 - #X4 

X 

X 

E 

3 - ?AX5 

* 

X 

F 

3 - #X6 

X 

X 

G 

3 - -^X7 

k 

0 

H 

3 - *X8 

0 

X 

J 

3 - ¥X9 

0 

X 

K 

3 - #X10 

X 

X 

L 

3 - *lXu 

it 

* 

M 

3 - »X,2 

0 

X 

N 

3 - #X13 

it 

X 

P 

3 - »XW 

it 

X 

Q 

3 - «J5 

0 

X 

R 

3 * «16 

* 

it 

S 

3 - «1? 

X 

X 

T 

3 - «lg 

X 

ic 

U 

3 - ^Xl9 

X 

X 

V 

3 - #X20 

X 

X 

W 

3 - tfX^ 

X 

0 

X 

3 * #X22 

* 

X 

*No  Observations  ^Statistically  °Not  Statistically 

Significant  Significant 
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Is  a disproportionate  amount  of  opportunity  cost 
caused  by  a small  number  of  overage  reason  codes? 


The  practical  significance  of  Research  Questions 
1 - Bf  C was  tested  by  the  application  of  the  following  two 
criteria* 

1.  A group  of  statistically  significant  reason  codes 
which  account  for  less  than  fifty  percent  of  the  twenty -two 
overage  reason  codes  must  be  identified. 

2.  The  above  group  must  be  responsible  for  more  than 
fifty  percent  of  the  total  available  opportunity  cost  for 
that  category  of  contracts. 

If  this  decision  rule  is  applied  to  the  reason  codes 


asterisked  on  Tables  10  and  11,  pages  40-49,  the  practical 
significance  of  Research  Questions  1 - Bj  C may  be  tested,  k 
summary  of  the  results  from  the  test  is  presented  in  Table  18. 
Research  Question  1 - C is  practically  significant.  Research 


Question  1 - 3 is  not  practically  signit icant. 


Table  18 

Practical  Significance  of  Research  Question  1 - B|  C 


i 

Codes  Having 
Tendency  to 

% of  Total 

Support  of 

| Research 

Increase  Over- 

Opportunity 

Practical 

Hypothesis 

age  Time  Span 

Cost 

Significance 

1 - B 

3 

4.03% 

No 

1 - C 

6 

65.41% 

Yes 

CHAPTER  V 

CONCLUSIONS  AND  RECOMMENDATIONS  FOR  FUTURE  STUDY 
Overview 

This  chapter  contains  the  conclusions  of  the  research 
effort.  Conclusions  associated  with  the  research  hypotheses 
and  conclusions  associated  with  the  research  questions  are 
presented  first.  These  conclusions  are  followed  by  related 
corollary  conclusions.  Recommendations  for  future  study  are 
discussed  after  the  corollary  conclusions.  Finally,  a brief 
summary  of  the  study  is  presented. 

Conclusions 

A major  part  of  this  research  effort  was  concerned 
with  the  relationship  between  the  time  span  a contract  Is 
overage  and  the  face  value  of  the  contract.  The  time  span  a 
contract  is  overage  tends  to  Increase  as  the  face  value  of 
the  contract  increases.  The  Category  C contracts  have  the 
largest  mean  face  value  and  the  longest  mean  time  overage. 
Category  B contracts  have  the  next  largest  mean  face  value 
and  the  next  longest  mean  time  overage.  These  results  Illus- 
trate a contradiction  in  priorities.  It  would  seem  that  the 
contracts  with  the  highest  face  value  should  receive  more 
management  attention  than  those  with  the  smaller  face  value. 
However,  this  is  not  the  case.  The  magnitude  of  the  face 
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value  of  the  contract  Is  a detriment  to  a timely  closure 
process.  The  higher  the  face  value  the  longer  the  contract 
remains  overage.  Several  conclusions  can  be  drawn  from  this 
fact i (1)  management  should  devote  more  time  to  contracts 
with  high  face  value  throughout  the  entire  closure  process t 
(2)  Category  C contracts,  contracts  with  the  highest  mean 
overage  time  span,  will  demand  more  administrative  effort  if 
a timely  closure  is  to  be  accomplished)  and  (3)  the  closure 
process  for  high  value  contracts  becomes  additionally  com- 
plex and  does  not  allow  the  contract  to  be  closed  within 
present  ASPR  time  standards.  In  conclusion,  substantial 
savings,  in  terms  of  administrative  and  opportunity  costs, 
can  be  obtained  if  more  management  effort  is  directed  toward 
high  dollar  contracts  during  the  contract-closure  process. 

A second  area  of  analysis  was  concerned  with  the 
relationship  between  the  unliquidated  obligation  remaining 
on  a contract  at  the  time  it  goes  overage  and  the  overage 
time  span.  The  investigation  indicated  that  as  the  amount 
of  IJLO  increased  the  overage  time  span  decreased.  There  arc 
several  possible  explanations  for  this  phenomena.  Since  the 
funds  have  been  obligated  to  the  contract,  but  have  not  yet 
been  paid,  the  contractor  will  fulfill  his  obligations  in 
the  closure  process  at  a more  rapid  rate.  Second,  a con- 
scious effort  on  the  part  of  the  administrative  contracting 
officer  to  deobligate  the  funds  focuses  attention  on  the  con- 
tract. This  additional  attention  results  in  a more  timely 
contract-closure.  Finally,  there  may  be  a synergistic  effect 
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resulting  from  a cooperative  effort  on  the  part  of  the  gov- 
ernment and  contractor  to  remove  excess  ULO.  This  coopera- 
tion for  mutual  benefit  may  promote  prompt  closure  of  the 
contracts  Conversely*  as  the  amount  of  ULO  decreases*  the 
overage  time  span  increases.  The  absence  of  ULO  or  a rela- 
tively small  amount  of  obligated  funds  remaining  on  contract 
may,  in  itself,  have  a negative  effect  on  the  contract- 
closure  process.  Since  the  money  involved  may  be  regarded 
as  insignificant,  there  may  be  a lack  of  motivation  to  effect 
prompt  and  timely  administrative  action.  Consequently,  the 
contract-closure  process  may  be  lengthened  unnecessarily, 
further  contributing  to  the  total  administrative  effort 
required. 

The  third  facet  of  this  study  addressed  the  relation- 
ships between  the  individual  overage  reason  codes  and  the 
time  span  a contract  was  overage.  The  research  uncovered 
both  expected  results  and  peculiarities  in  the  Category  B and 
C contracts.  The  conclusions  which  can  be  drawn  from  these 
results  must  be  treated  separately. 

Category  B contracts  had  only  three  reason  codes 
which  were  comparatively  unique.  These  reason  codes  were* 

(D)  Patent/royalty  clearance  required 

(S)  Litigation/investigation  pending 

(T)  Termination 

The  above  reason  codes  tended  to  keep  a Category  B contract 
open  longer  than  the  other  codes  within  this  category.  The 
appearance  of  Reason  Code  D Indicates  that  patent  and  royalty 
clearance  for  fixed  price  contracts  needs  added  emphasis  and 
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monitoring.  The  fact  that  litigation/investigation,  Reason 
Code  $,  caused  contracts  to  be  open  longer  was  not  surprising. 
Prior  to  performing  analysis  several  personnel  responsible 
for  contract -closure  activities  Indicated  that  litigation  of 
contracts  would  prove  to  be  a stumbling  block  In  the  timely 
closure  of  contracts.  Personnel  interviewed  stated  a belief 
that  closer  management  scrutiny  would  prevent  the  contract 
from  entering  that  area  of  conflict.  A discussion  of  con- 
tractual controls  to  eliminate  constructive  change  notices 
and  other  contractual  conditions  which  generate  claims  on 
the  part  of  the  contractor  Is  beyond  the  scope  of  this 
research.  The  appearance  of  Reason  Code  T,  Termination, 
although  surprising,  is  not  without  explanation.  The  contrac- 
tor Is  allowed  one  year  to  submit  his  final  voucher  In  the 
case  of  termination  whereas  the  time  span  allowed  for  closure 
of  Category  B contracts  Is  only  six  months . It  can  be  con- 
cluded, therefore,  that  there  is  a basic  conflict  between 
closure  and  termination  procedures.  This  conflict  in  proce- 
dures should  be  corrected  by  the  ASPR  Committee. 

A different  group  of  overage  reason  codes  are  tend- 
ing to  keep  Category  C contracts  overage.  These  reason  codes 
are  i 

(A)  Contractor  has  not  submitted  final  invoice/ 
voucher 

(H)  Final  audits  in  process 

(N)  Additional  funds  requested  but  not  yet  received 

(Q)  Armed  Services  Board  of  Contract  Appeals  ( ASBCA) 
case 
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(S)  Litigation/investigation  pending 
(X)  Contract  release  and  assignment  pending 
Two  of  the  above  six  reason  codes,  Q and  S,  are  related  to 
the  appeals  procedures  of  contract  administration.  These 
findings  supported  a priori  beliefs  concerning  the  ASBCA  and 
litigation.  A contract  coded  with  these  reason  codes  does, 
in  fact,  have  an  extended  overage  time  span.  The  fact  that 
Reason  Code  H appeared  to  be  ar.  influence  in  lengthening  the 
overage  time  span  suggests  that  the  Defense  Contract  Audit 
Agency  (DCAA)  is  placing  more  emphasis  on  the  audit  of  esti- 
mated costs  in  comparison  to  costs  already  incurred.  Reason 
Code  N,  however,  may  be  the  key  to  the  appearance  of  the 
other  reason  codes,  excluding  Q and  S.  Reason  Code  N might 
be  appearing  because  of  excessive  deobligation  of  funds 
remaining  on  a contract.  If  excessive  funds  are  deobligated, 
and  not  enough  ULO  remains  to  make  final  payment,  additional 
funds  must  be  requested.  This  will  delay  submission  of  the 
contractor's  final  voucher.  The  final  audit  will,  in  turn, 
be  delayed  as  will  the  contract  release.  More  precise  calcu- 
lation of  the  amount  of  ULO  to  be  deobligated  could  preclude 
this  chain  of  events  and  the  resulting  increase  in  overage 
time  span.  To  summarize,  it  can  be  stated  that  individual 
overage  reason  codes  are  factors  in  the  length  of  time  a 
contract  remains  overage.  As  presented  in  Chapter  III, 

Table  9,  page  43,  each  reason  code  is  associated  with  a 
unique  increment  of  overage  time  span.  The  overage  time  span 
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will  thus  vary  according  to  the  reason  code  causing  the 
contract  to  go  overage. 

The  final  conclusions  are  related  to  Research  Ques- 
tions 1 - Bt  C.  Category  B contracts  do  not  have  a small 
group  of  overage  reason  codes  which  account  for  a large  por- 
tion of  the  total  opportunity  cost  calculated  for  this  cate- 
gory. This  fact  Indicates  that  those  reason  codes  which 
keep  contracts  overage  longer  are  not  related  to  contracts 
that  have  large  amounts  of  ULO,  which  ultimately  result  In 
opportunity  costs.  Category  C contracts,  on  the  other  hand, 
have  a group  of  six  reason  codes  which  account  for  over  65 
percent  of  the  total  opportunity  cost  calculated  for  Cate- 
gory C.  These  reason  codes  and  their  associated  explanations 
are  i 

(A)  Contractor  has  not  submitted  final  voucher/ 
Invoice 

(H)  Final  audit  In  process 

(N)  Additional  funds  requested  but  net  yet  received 

(Q)  Armed  Services  Board  of  Contract  Appeals  (ASBCA) 
case 

(S)  Lltlgatlon/lnvestlgatlon  pending 

(X)  Contract  release  and  assignment  pending 
The  above  six  reason  codes  are  the  same  as  those  shown  to 
keep  Category  C contracts  overage  comparatively  longer  than 
the  other  overage  reasoi.  codes.  They  are  also  responsible 
for  a majority  of  the  opportunity  cost  incurred.  Therefore, 
management  emphasis  on  the  high  value  Category  C contracts 
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in  these  specific  areas  can  help  preclude  overage  contracts 
and  thus  reduce  opportunity  costs. 

Corollary  Conclusions 

Although  not  statistically  supported,  several  corol- 
lary conclusions  may  be  drawn  from  the  data  reviewed  during 
this  investigation! 

1.  The  Contract  Status  Report  (CSR)  issued  at 
Headquarters,  Air  Force  Contract  Management  Division,  appears 
to  be  receiving  insufficient  attention  from  contract  admin- 
istration personnel.  The  absence  of  overage  reason  codes, 
and  the  use  of  multiple  reason  codes  are  evidence  of  incon- 
sistency in  reporting.  Of  the  1359  overage  contracts  listed 
on  the  28  February  1975  CSR,  only  888  were  included  in  this 
study  because  of  anomalies  in  the  data  base.  Appendix  E, 
page  97,  provides  a summary  of  the  contracts  deleted  from  the 
data  base. 

2.  The  Category  A contracts  have  the  lowest  dollar 
value  and  consequently  the  lowest  ULO.  The  small  dollar 
amounts  involved  probably  account  for  the  apparent  lack  of 
emphasis  placed  on  the  closure  of  these  type  contracts. 
Further,  DD  Form  1597,  the  Contract-Closure  Check-List,  doe? 
not  consider  the  closure  process  for  Category  A contracts 
(reference  Appendix  A,  page  83).  As  a result,  94  percent  ot 
the  Category  A contracts  on  the  28  February  1975  CSR  did  not 
h^ve  an  overage  reason  code. 

3.  Not  enough  emphasis  is  being  placed  on  the  clo- 
sure of  contracts.  The  fact  that  opportunity  costs  of 
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approximately  2.8  million  dollars  was  calculated  on  the 
overage  contracts  under  study  for  this  report  indicates  that 
the  system  could  be  Improved.  Since  the  other  Department 
of  Defense  contract  administration  components  are  assumed  to 
use  similar  procedures,  there  is  a possibility  that  they  may 
have  similar  problems. 

A,  Twenty-four  contracts  with  larger  than  average 
face  value  and  unliquidated  obligation  had  no  Original  Mile- 
stone Closing  Date,  but  did  have  a Revised  Milestone  Closing 
Date.  Since  27  percent  of  the  total  ULO  listed  on  the  CSR 
is  attributable  to  these  contracts,  it  would  appear  that  a 
significant  amount  of  opportunity  cost  is  being  incurred  by 
these  contracts.  Management  attention  to  these  selected 
contracts  would  probably  result  in  substantial  opportunity 
cost  savings. 

5.  This  research  has  not  addressed  the  administra- 
tive costs  associated  with  the  contract -closure  process. 

At  this  time,  it  is  not  possible  to  estimate  the  number  of 
actions  or  the  amount  of  time  expended  trying  to  close  an 
individual  contract  each  month.  However,  it  appears  that 
an  extended  contract- closure  process  is  time  consuming  and 
costly. 

6.  The  models  used  considered  only  the  effect  of 
face  value,  unliquidated  obligation,  and  overage  reason  code. 
The  results  indicated  that  behavioral  variables  of  the 
contract-closure  process  may  be  affecting  the  overage  time 
span. 
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7,  Category  C contracts  have  a tendency  to  be  over- 
age longer  than  Category  A and  Category  B contracts.  This 
fact  provides  support  for  and  closely  parallels  the  differ- 
ence in  the  closure-time  standards  contained  in  ASPS  2-3C5. 

8.  An  increase  in  the  closure- time  standards  speci- 
fied in  ASPS  2-305  is  not  a possible  solution  to  the  problem 
of  overage  contracts.  An  increase  in  the  time  standards 
would  be  an  administrative  cover  to  hide  the  problem  and 
would  not  treat  the  cause. 

Recommended  Future  Studies 

During  the  course  of  this  research  effort,  several 
topics  which  warrant  future  research  were  encountered.  A 
discussion  of  these  topics  follows t 

1.  This  study  was  confined  to  contracts  being 
administered  by  AFCMD.  No  data  was  obtained  on  DCAS  con- 
tracts. Therefore,  we  recommend  that  a similar  study  be 
conducted  to  analyze  the  overage  time  spans  and  opportunity 
cost  of  contracts  under  the  jurisdiction  of  DCAS.  The 
authors  believe  that  since  the  ASPR  applies  to  both  organi- 
zations, the  results  would  be  similar  in  both  studies. 

Similar  studies  could  be  performed  on  NASA  contracts 
being  administered  by  AFCMD.  Currently,  information  on  NASA 
contracts  is  not  reflected  in  the  physically  complete  section 
of  the  CSR. 

2.  The  administrative  procedures  of  the  contract- 
closure  process  should  be  reviewed.  A study  to  examine  the 
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methodology  used  by  AGO's  to  effect  contract- closure  could 
have  an  Impact  on  decreasing  the  overage  tine  span. 

3.  A study  to  determine  the  administrative  costs 
associated  with  the  contract-closure  process  should  be  con- 
ducted. There  is  evidence  which  Indicates  that  the  costs 
associated  with  not  closing  a contract  might  be  excessive. 

4.  A corollary  study  to  determine  the  disposition 
of  ULO  should  be  performed.  The  specific  question  which 
should  be  answered  lsi  Of  those  contracts  physically  com- 
plete with  ULO  remaining,  what  percentage  of  the  ULO  Is 
ultimately  released  to  other  government  programs? 

5.  The  question  of  the  usefulness  of  the  CSR  should 
be  examined  in  detail.  Is  the  report  being  prepared  properly 
and  does  the  existence  of  this  report  prompt  contract  manage- 
ment personnel  to  take  timely  action  to  complete  the  closure 
process? 

Sugary 

The  contract -closure  process  receives  a low  priority 
on  the  list  of  contract  administration  activities.  The  fact 
that  at  least  2. ft  million  dollars  of  opportunity  cost  Is 
being  Incurred  by  the  overage  contracts  being  administered  by 
AFOiD  emphasizes  this  fact.  All  organizations  concerned  with 
the  contract-closure  process  should  place  more  emphasis  on 
this  aspect  of  contract  administration.  There  Is  a need  for 
a review  and  consolidation  of  the  policies  ana  procedures 
related  to  contract-closure. 
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APPENDIX  A 

FORMS  RELATED  TO  CONTRACT- CLOSURE 

1.  DD  Form  1597 --Contract  Close-Out  Checklist 

2.  DO  Form  1593 --Contract  Administration  Completion  Record 

3.  DD  Form  1594- -Contract  Completion  Statement 
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APPENDIX  B 


LIST  OF  PERSONNEL  INTERVIEWED 


1#  Crawford , Mr.  Jack  R.  Auditor,  Air  F^rce  Audit  Agency, 
Office  of  the  Air  Force  Auditor  General,  Wright- 
Patterson  AFB,  Ohio.  Personal  interview.  22  October 
1974. 

2.  Bkb®1 , Ms.  Jean.  Data  Specialist,  Operations  Reports 

and  Records,  Contract  Policy  Directorate,  Aero- 
nautical Systems  Division,  Wright -Patterson  AFB, 

Ohio.  Personal  interview,  ll  October  1974. 

3.  Fedele,  Mr.  Angelo.  Contracting  Officer,  Directorate 

of  Procurement  and  Production  Support,  Headquarters 
Air  Force  Systems  Command,  Washington,  D.C.  Per- 
sonal telephone  Interview.  3 October  1974. 

4.  fIernan,  Mr.  Jack  E.  Closure  Specialist,  Contract -Closure 

Branch,  Contract  Policy  Directorate,  Aeronautical 
Systems  Division,  Wright-Patterson  AFB,  Ohio.  Per- 
sonal interview,  11  October  1974. 

5.  Mlchalowski,  Major  Thomas  J.  Research  Associate,  Air 

Force  Business  Research  Management  Center  (Hq  USAF), 
Wright -Patterson  AFB,  Ohio.  Personal  interview. 

8 October  1974, 

6.  O’Neill,  Mr.  Donald  J.  Contracting  Officer,  Systems 

Program  Office,  Acquisition  Management  Information 
System  (AMIS),  Air  Force  Systems  Command,  Wright- 
Patterson  AFB,  Ohio.  Personal  interview. 

9 October  1974, 

7.  Pfeifer,  Mr.  James.  Contract  Specialist,  Air  Force 

Plant  Representative  Office,  Air  Force  Contract 
Management  Division,  Evendale,  Ohio.  Personal 
interview,  7 October  1974, 

8.  Poe,  Major  William  E.  Course  Director,  Advanced  Con- 

tract Administration,  Continuing  Education  Division, 
Air  Force  Institute  of  Technology,  School  of  Systems 
and  Logistics,  Wright-Patterson  AFB,  Ohio.  Personal 
interview.  29  October  1974 „ 
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9.  Schaeffer,  Mr.  James.  Technical  Assistant  to  the 

Director,  Contract  Policy  Directorate,  Aeronautical 
Systems  Division,  Wright-Patterson  AFB,  Ohio.  Per* 
sonal  interview.  11  October  1974, 

10.  Schlobohm,  Mr.  William  A.  Contract  Administrator, 

Contracts  Division,  Air  Force  Contract  Management 
Division,  Kirtland  AFB,  New  Mexico.  Personal  inter- 
view, 27  November  1974, 

11.  Smallwood,  Mr.  Lowell  S.  Closure  Specialist,  Contract- 

Closure  Branch,  Contract  Policy  Directorate,  Aero- 
nautical Systems  Division,  Wright-Patterson  AFB, 
Ohio.  Personal  interview.  11  October  1974, 

12.  Stubblebine,  Captain  Thomas  J.  Accountant,  Comptrol- 

ler's Office,  Aeronautical  Systems  Division, 
Wright-Patterson  AFB,  Ohio.  Personal  interview. 

22  October  1974. 

13.  Terzian,  Mr.  R.  H,  Course  Director,  Basic  Contract 

Administration,  Continuing  Education  Division,  Air 
Force  Institute  of  Technology,  School  of  Systems 
and  Logistics,  Wright-Patterson  AFB,  Ohio.  Per- 
sonal interview.  29  October  1974. 

14.  V\=nn,  Major  Porter  W.  Chief,  Accounting  and  Finance, 

Comptroller,  Aeronautical  Systems  Division,  Wright- 
Patterson  AFB i Ohio.  Personal  interview, 

23  October  1974. 

15.  Wallace,  Mr.  Max  E.  Logistics  Specialist,  Systems  Pro- 

gram Office  (AMIS),  Air  Force  Systems  Command, 
Wright-Patterson  AFB,  Ohio,  Personal  interview. 

25  September  1974, 
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SUMMARY  OF  OPPORTUNITY  COST 


Opportunity  Cost  Summary --Category  B 


Season 

Code 

Explanation  of 
Reason  Codes 

Number  of 
Observations 

ULO 

Opportunity 

Cost 

A 

Contractor  Final 
Voucher 

21 

$447,646 

$ 65,396 

B 

Final  Acceptance 

3 

1 

0 

C 

Contractor 
Patent  Report 

0 

0 

0 

D 

Patent/Royalty 

Clearance 

6 

0 

0 

E 

Final  Price 
Redetermination 

0 

0 

0 

F 

Supplemental 

Settlement 

6 

0 

0 

G 

Subcontract 

Settlement 

0 

0 

0 

H 

Final  Audit 

1 

6,172 

508 

J 

Disallowed  Cost 

1 

1 

C 

K 

Audit  of  Gov'mt 
Property 

9 

212,460 

19,317 

L 

R«D  Rates 
Pending 

0 

0 

0 

M 

Overhead  Rates 

3 

0 

0 

N 

Additional  Funds 
Requested 

0 

0 

0 

P 

Reconciliation 

w/Finance 

0 

0 

0 

Q 

ASBCA 

2 

7,861 

995 

R 

Public  Law  85-804  0 

Case 

0 

0 

C 

• > 

Litigation 

2 

4,550 

1,409 
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Opportunity  Cost  Summary- -Category  C 


Reason 

Code 

Explanation  of  Number  of 

Reason  Codes  Observations 

ULO 

Opportunity 

Cost 

A 

Contractor  Final 
Voucher 

108 

$1,098,933 

$ 359,322 

B 

Final  Acceptance 

5 

16,468 

2,225 

C 

Contractor 
Patent  Report 

0 

0 

0 

D 

Patent /Royalty 
Clearance 

8 

410 

20 

E 

Final  Price 
Redetermination 

38 

413,480 

33,214 

F 

Supplemental 

Agreement 

27 

2,075,866 

189,247 

G 

Subcontract 

Settlement 

1 

3,281 

753 

H 

Final  Audit 

17 

606,877 

105,215 

J 

Disallowed  Cost 

4 

4 

108 

K 

Audit  of  Gov'rat 
Property 

23 

0 

0 

L 

R&D  Rates 
Pending 

0 

0 

0 

M 

Overhead  Rates 

286 

1,347,657 

217,781 

N 

Additional  Funds 
Requested 

7 

281 

111 

P 

Reconciliation 

w/Finance 

27 

24,786 

4,699 

Q 

ASBCA 

97 

1,116,997 

181,960 

R 

Public  Law  85-804 
Case 

0 

0 

0 

S 

Litigation 

102 

888,460 

244,095 

T 

Termination 

0 

0 

0 

U 

Warranty  Clause 

24 

2,756 

91 

V 

Disposition  Gov*mt  12 

Property 

68,339 

170,044 

w 

Contract 

Modification 

1 

0 

0 

X 

Contract  Release 

10 

851.021 

278.115 

TOTAL 

797 

$9,129,674 

$1,787,006 

APPENDIX  D 


SUMMARY  OF  CATEGORY  C CONTRACTS 
WITH  NO  OVERAGE  TIME  SPAN 


Contract 

Number 

Face  Value 
(Dollars) 

ULO 

(Dollars) 

Reason 

1 

60,756,331 

104,228 

X 

2 

206,176,807 

308,974 

XV 

3 

22,362,141 

31,826 

- 

4 

7,653,759 

86,523 

SQ 

5 

3,071,384 

521 

SQ 

e> 

4,149,960 

80,000 

SQ 

7 

3,610,771 

39,756 

SQ 

8 

10,154,000 

- 

- 

9 

70,913,548 

<-)  3,157,074 

ST 

10 

250,000 

4,111 

HAU 

11 

25,100,000 

- 

MDV 

12 

16,506,575 

77,248 

MA 

13 

211,679,748 

7,457 

MG 

14 

246,063,747 

F 

15 

101,780,266 

200,628 

- 

16 

101,386,141 

777,131 

Q 

17 

45,348,994 

154,735 

Q 

18 

805,095 

- 

M 

19 

4,521,889 

52,213 

J 

20 

16,974,260 

30,293 

M 

21 

191,358,910 

19,116 

M 

22 

122,023,623 

90,835 

M 

23 

49,982,000 

38,510 

M 

24 

78.446.613 

39.415 

A 

TOTAL 

1,601,076,562 

5,300,594 

MEAN 

66,111,523 

220,858 
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